Apr 14 00:00:50 user cinder-volume[84462]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84462) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 00:00:50 user cinder-volume[84462]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84462) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 00:00:50 user cinder-volume[84462]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84462) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 00:00:51 user cinder-volume[84462]: INFO dbcounter [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Registered counter for database cinder Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_db.sqlalchemy.engines [None req-c2947f61-f913-42fd-8426-940927339f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84462) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG dbcounter [-] [84462] Writer thread running {{(pid=84462) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.rpc [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.rpc [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_db.sqlalchemy.engines [None req-c2947f61-f913-42fd-8426-940927339f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84462) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.volume.manager [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Determined volume DB was empty at startup. Apr 14 00:00:51 user cinder-volume[84462]: DEBUG cinder.volume.manager [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84462) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.volume.manager [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 14 00:00:51 user cinder-volume[84462]: WARNING stevedore.named [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 00:00:51 user cinder-volume[84462]: WARNING castellan.key_manager [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 00:00:51 user cinder-volume[84462]: WARNING cinder.keymgr.conf_key_mgr [None req-c2947f61-f913-42fd-8426-940927339f54 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_db.sqlalchemy.engines [None req-c2947f61-f913-42fd-8426-940927339f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84462) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.rpc [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.rpc [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Automatically selected cinder-volume RPC version 3.18 as minimum service version. Apr 14 00:00:51 user cinder-volume[84462]: WARNING stevedore.named [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 14 00:00:51 user cinder-volume[84462]: WARNING castellan.key_manager [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 14 00:00:51 user cinder-volume[84462]: INFO cinder.volume.manager [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Image-volume cache enabled for host user@joviandss-2. Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_db.sqlalchemy.engines [None req-c2947f61-f913-42fd-8426-940927339f54 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84462) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 00:00:51 user cinder-volume[84462]: INFO oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Starting 1 workers Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Started child 84560 {{(pid=84462) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Full set of CONF: {{(pid=84462) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] ******************************************************************************** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] Configuration options gathered from: {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] ================================================================================ {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] allow_availability_zone_fallback = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] allow_compression_on_image_upload = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] allowed_direct_url_schemes = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] api_rate_limit = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84560]: INFO cinder.service [-] Starting cinder-volume node (version 22.1.0) Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] auth_strategy = keystone {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] az_cache_duration = 3600 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_availability_zone = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_host = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_stats_polling_interval = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backup_api_class = cinder.backup.api.API {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backup_name_template = backup-%s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backup_use_same_host = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backup_use_temp_snapshot = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] chap_password = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] chap_password_len = 12 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] chap_username = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_internal_tenant_project_id = 1c8fe019fcbc488f9d8248e0eca402ee {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_internal_tenant_user_id = b9331a1f999143889ce4303e30c9de3f {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cloned_volume_same_az = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cluster = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] compression_format = gzip {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] compute_api_class = cinder.compute.nova.API {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] config_dir = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] config_source = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] control_exchange = openstack {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] debug = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] default_availability_zone = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] default_group_type = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] default_volume_type = joviandss-2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] driver_client_cert = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] driver_client_cert_key = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] driver_data_namespace = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] driver_ssl_cert_path = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] driver_ssl_cert_verify = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] driver_use_ssl = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] enable_force_upload = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] enable_new_services = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] enable_unsupported_driver = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] enabled_backends = ['joviandss-2'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] enforce_multipath_for_image_xfer = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] filter_function = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_api_insecure = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_api_servers = ['http://10.0.0.210/image'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_api_ssl_compression = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_ca_certificates_file = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_catalog_info = image:glance:publicURL {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_num_retries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] glance_request_timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] goodness_function = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] graceful_shutdown_timeout = 5 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] group_api_class = cinder.group.api.API {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] host = user {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iet_conf = /etc/iet/ietd.conf {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_compress_on_upload = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_conversion_address_space_limit = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_conversion_cpu_limit = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_conversion_disable = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_upload_use_cinder_backend = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_upload_use_internal_tenant = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_volume_cache_enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_volume_cache_max_count = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] image_volume_cache_max_size_gb = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] init_host_max_objects_retrieval = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] instance_format = [instance: %(uuid)s] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iscsi_iotype = fileio {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iscsi_target_flags = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iscsi_write_cache = on {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iser_helper = tgtadm {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iser_ip_address = 10.0.0.210 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iser_port = 3260 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] jovian_block_size = 64K {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] jovian_ignore_tpath = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] jovian_pool = Pool-0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] jovian_recovery_delay = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_config_append = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Starting volume driver JovianISCSIDriver (1.0.2) Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_dir = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_file = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_options = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_rotate_interval = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_rotate_interval_type = days {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] log_rotation_type = none {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] check pool {{(pid=84560) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] max_age = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] max_logfile_count = 30 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] max_logfile_size_mb = 200 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] max_over_subscription_ratio = 20.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] message_reap_interval = 86400 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] message_ttl = 2592000 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] migration_create_volume_timeout_secs = 300 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] monkey_patch = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] monkey_patch_modules = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] my_ip = 10.0.0.210 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] no_snapshot_gb_quota = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] num_iser_scan_tries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] num_shell_tries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] num_volume_device_scan_tries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] nvmeof_conn_info_version = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] nvmet_ns_id = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] nvmet_port_id = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_max_limit = 1000 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_volume_ext_list = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_volume_listen_port = 8776 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_volume_use_ssl = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] osapi_volume_workers = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] per_volume_size_limit = -1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] periodic_fuzzy_delay = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] periodic_interval = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] public_endpoint = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] publish_errors = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_backup_gigabytes = 1000 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_backups = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_consistencygroups = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_gigabytes = 1000 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_groups = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_snapshots = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] quota_volumes = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] rate_limit_burst = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] rate_limit_except_level = CRITICAL {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] rate_limit_interval = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] reinit_driver_count = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] replication_device = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] report_discard_supported = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] report_interval = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] reservation_clean_interval = 86400 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] reservation_expire = 86400 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] reserved_image_namespaces = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] reserved_percentage = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] rpc_response_timeout = 120 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] run_external_periodic_tasks = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] san_hosts = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] scst_target_driver = iscsi {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] scst_target_iqn_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_down_time = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] snapshot_name_template = snapshot-%s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] snapshot_same_host = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] split_loggers = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] ssh_hosts_key_file = /opt/stack/data/cinder/ssh_known_hosts {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] state_path = /opt/stack/data/cinder {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] storage_availability_zone = nova {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] storage_protocol = iSCSI {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] strict_ssh_host_key_policy = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] syslog_log_facility = LOG_USER {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] target_helper = lioadm {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] target_ip_address = 10.0.0.210 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] target_port = 3260 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] target_protocol = iscsi {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] target_secondary_ip_addresses = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] trace_flags = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] transport_url = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] until_refresh = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_chap_auth = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_default_quota_class = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_eventlog = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_journal = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_json = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_multipath_for_image_xfer = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_stderr = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] use_syslog = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] verify_glance_signatures = enabled {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_api_class = cinder.volume.api.API {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_backend_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_clear = zero {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_clear_ionice = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_clear_size = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_copy_bps_limit = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_dd_blocksize = 1M {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_name_template = volume-%s {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_service_inithost_offload = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volume_usage_audit_period = month {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] watch_log_file = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] zoning_mode = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_concurrency.disable_process_locking = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.admin_password = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.admin_token = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.admin_user = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_port = 35357 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_protocol = https {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_section = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_type = password {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_uri = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.auth_version = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.cache = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.identity_uri = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.include_service_catalog = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.insecure = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.interface = public {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.region_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.service_type = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.backend = dogpile.cache.null {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.backend_argument = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.config_prefix = cache.oslo {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.dead_timeout = 60.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.debug_cache_backend = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.enable_retry_client = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.enable_socket_keepalive = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.expiration_time = 600 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.hashclient_retry_attempts = 2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.hashclient_retry_delay = 1.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_dead_retry = 300 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_password = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_pool_maxsize = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_sasl_enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_socket_timeout = 1.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.memcache_username = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.proxies = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.retry_attempts = 2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.retry_delay = 0.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.socket_keepalive_count = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.socket_keepalive_idle = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.socket_keepalive_interval = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.tls_allowed_ciphers = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.tls_cafile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.tls_certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.tls_enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cache.tls_keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] coordination.backend_url = etcd3+http://10.0.0.210:2379 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.backend = sqlalchemy {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.connection = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.connection_debug = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.connection_parameters = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.connection_recycle_time = 3600 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.connection_trace = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.db_inc_retry_interval = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.db_max_retries = 20 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.db_max_retry_interval = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.db_retry_interval = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.max_overflow = 50 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.max_pool_size = 5 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.max_retries = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.mysql_enable_ndb = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.mysql_wsrep_sync_wait = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.pool_timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.retry_interval = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.slave_connection = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.sqlite_synchronous = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] database.use_db_reconnect = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.enforce_new_defaults = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.enforce_scope = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.policy_default_rule = default {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.policy_file = policy.yaml {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.connection_string = messaging:// {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.es_doc_type = notification {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.es_scroll_size = 10000 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.es_scroll_time = 2m {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.filter_error_trace = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.hmac_keys = SECRET_KEY {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.sentinel_service_name = mymaster {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.socket_timeout = 0.1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] profiler.trace_sqlalchemy = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] privsep_osbrick.capabilities = [21] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] privsep_osbrick.group = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] privsep_osbrick.helper_command = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] privsep_osbrick.user = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_sys_admin.group = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_sys_admin.helper_command = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_sys_admin.thread_pool_size = 12 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] cinder_sys_admin.user = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.auth_section = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.auth_type = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.cafile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.collect_timing = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.insecure = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.send_service_user_token = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.split_loggers = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] service_user.timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.backend_availability_zone = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.chap_password = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.chap_username = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.driver_client_cert = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.driver_client_cert_key = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.driver_data_namespace = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.driver_use_ssl = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.extra_capabilities = {} {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.filter_function = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.goodness_function = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iscsi_iotype = fileio {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iscsi_target_flags = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iscsi_write_cache = on {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iser_helper = tgtadm {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iser_ip_address = 10.0.0.210 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iser_port = 3260 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.num_shell_tries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.replication_device = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.report_discard_supported = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.reserved_percentage = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_api_port = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_clustername = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_ip = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_is_local = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_login = admin {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_password = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_private_key = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_ssh_port = 22 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.san_thin_provision = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.ssh_conn_timeout = 30 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.ssh_max_pool_conn = 5 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.ssh_min_pool_conn = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.target_helper = tgtadm {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.target_ip_address = 10.0.0.210 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.target_port = 3260 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.target_protocol = iscsi {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.trace_flags = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.unique_fqdn_network = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.use_chap_auth = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_backend_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_clear = zero {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_clear_ionice = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_clear_size = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_reports.file_event_handler = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_reports.log_dir = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.backend_availability_zone = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.backend_host = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.backend_native_threads_pool_size = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.backup_use_temp_snapshot = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.chap_password = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.chap_username = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.chiscsi_conf = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.driver_client_cert = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.driver_client_cert_key = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.driver_data_namespace = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.driver_ssl_cert_path = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.driver_ssl_cert_verify = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.driver_use_ssl = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.enable_unsupported_driver = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.enforce_multipath_for_image_xfer = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.extra_capabilities = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.filter_function = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.goodness_function = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iet_conf = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.image_upload_use_cinder_backend = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.image_upload_use_internal_tenant = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.image_volume_cache_enabled = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.image_volume_cache_max_count = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.image_volume_cache_max_size_gb = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iscsi_iotype = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iscsi_target_flags = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iscsi_write_cache = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iser_helper = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iser_ip_address = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iser_port = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.iser_target_prefix = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.max_over_subscription_ratio = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.num_iser_scan_tries = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.num_shell_tries = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.num_volume_device_scan_tries = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.nvmeof_conn_info_version = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.nvmet_ns_id = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.nvmet_port_id = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.replication_device = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.report_discard_supported = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.reserved_percentage = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.scst_target_driver = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.scst_target_iqn_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.storage_protocol = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.suppress_requests_ssl_warnings = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.target_helper = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.target_ip_address = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.target_port = 3260 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.target_prefix = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.target_protocol = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.target_secondary_ip_addresses = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.trace_flags = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.unique_fqdn_network = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.use_chap_auth = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.use_multipath_for_image_xfer = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_backend_name = joviandss-2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_clear = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_clear_ionice = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_clear_size = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_copy_blkio_cgroup_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_copy_bps_limit = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_dd_blocksize = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volume_driver = cinder.volume.drivers.open_e.iscsi.JovianISCSIDriver {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] joviandss-2.volumes_dir = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.ssl = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_notifications.driver = [] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_notifications.retry = -1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] key_manager.fixed_key = **** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.barbican_api_version = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.barbican_endpoint = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.barbican_endpoint_type = public {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.barbican_region_name = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.cafile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.collect_timing = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.insecure = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.number_of_retries = 60 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.retry_delay = 1 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.send_service_user_token = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.split_loggers = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.verify_ssl = True {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican.verify_ssl_path = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.auth_section = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.auth_type = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.cafile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.collect_timing = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.insecure = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.split_loggers = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] barbican_service_user.timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.approle_role_id = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.approle_secret_id = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.cafile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.certfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.collect_timing = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.insecure = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.keyfile = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.kv_mountpoint = secret {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.kv_version = 2 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.namespace = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.root_token_id = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.split_loggers = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.ssl_ca_crt_file = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.timeout = None {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.use_ssl = False {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 00:00:51 user cinder-volume[84462]: DEBUG oslo_service.service [None req-c2947f61-f913-42fd-8426-940927339f54 None None] ******************************************************************************** {{(pid=84462) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 00:00:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359517184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:00:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] check pool {{(pid=84560) is_pool_exists /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:71}} Apr 14 00:00:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:00:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359517184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359517184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:00:53 user cinder-volume[84560]: INFO cinder.volume.driver [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Driver hasn't implemented _init_vendor_properties() Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Initialized capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84560) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:832}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84560) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writer thread running {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.db.sqlalchemy.api [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Building query based on filter {{(pid=84560) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3885}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84560) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1146}} Apr 14 00:00:53 user cinder-volume[84560]: INFO cinder.keymgr.migration [None req-acc0b171-79ed-4e4a-9bf6-143de876cc27 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:00:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359517184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:00:54 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Driver initialization completed successfully. Apr 14 00:00:54 user cinder-volume[84560]: INFO cinder.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Initiating service 2 cleanup Apr 14 00:00:54 user cinder-volume[84560]: INFO cinder.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Service 2 cleanup completed. Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.service [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Creating RPC server for service cinder-volume {{(pid=84560) start /opt/stack/cinder/cinder/service.py:238}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.service [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84560) start /opt/stack/cinder/cinder/service.py:244}} Apr 14 00:00:54 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Initializing RPC dependent components of volume driver JovianISCSIDriver (1.0.2) Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:00:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:00:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359517184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:00:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:00:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c9aaf051-751f-40de-970c-06e0502d2dea None None] Driver post RPC initialization completed successfully. Apr 14 00:01:01 user cinder-volume[84462]: DEBUG dbcounter [-] [84462] Writing DB stats cinder:SELECT=16,cinder:INSERT=1 {{(pid=84462) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:01:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:01:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=23,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:01:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:01:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:01:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:02:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:02:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359504896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:02:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:02:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:02:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:03:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:03:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359504896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:03:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:03:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:03:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359504896', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:04:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:04:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b2afd00b-18a2-4b9e-895a-e79fed167c95 tempest-GroupSnapshotsV319Test-1944498755 None] Group tempest-GroupSnapshotsV319Test-Group-177822716: creating Apr 14 00:04:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b2afd00b-18a2-4b9e-895a-e79fed167c95 tempest-GroupSnapshotsV319Test-1944498755 None] Group tempest-GroupSnapshotsV319Test-Group-177822716: created successfully Apr 14 00:04:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b2afd00b-18a2-4b9e-895a-e79fed167c95 tempest-GroupSnapshotsV319Test-1944498755 None] Create group completed successfully. Apr 14 00:04:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4e31c9e6-8d4f-4229-8079-ca370c316e59 tempest-BackendsCapabilitiesAdminTestsJSON-227286978 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 00:04:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-936fda52-0997-49eb-8811-6fc6fb12cd5a tempest-BackendsCapabilitiesAdminTestsJSON-227286978 None] Obtained capabilities list: {'vendor_name': 'Open-E', 'driver_version': '1.0.2', 'storage_protocol': 'iSCSI', 'total_capacity_gb': 119, 'free_capacity_gb': 106, 'reserved_percentage': 0, 'volume_backend_name': 'joviandss-2', 'QoS_support': False, 'location_info': 'JovianISCSIDriver:1:Pool-0', 'multiattach': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4784}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Flow 'volume_create_manager' (6f256577-6f46-40d5-96fd-fc42e6ca6413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87c21d2-22dd-42fb-ac5f-b2172a98dc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d87c21d2-22dd-42fb-ac5f-b2172a98dc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223538497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f712857c-8ab1-4203-8999-40d54113f885,host='user@joviandss-2#joviandss-2',id=b23333e7-c08b-48d1-a9a7-b1e31d237a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbc800e8cad458fb57691ec1a4d652d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:04:32Z,use_quota=True,user_id='ca8b6288847e445d94958a262e302c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62e62f30-921c-433e-9b35-39f2d06c902c),volume_type_id=62e62f30-921c-433e-9b35-39f2d06c902c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a08f71b-737c-4afe-b6be-d213cc18106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a08f71b-737c-4afe-b6be-d213cc18106e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9c9624-a9ca-4eab-b3ea-29c0b6357d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c9c9624-a9ca-4eab-b3ea-29c0b6357d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'volume_name': 'volume-b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194d9bbb-9058-454f-8476-1d41bd1e7ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194d9bbb-9058-454f-8476-1d41bd1e7ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31d6f95-233f-4de3-83bf-6bd20f8fd2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:32 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Volume b23333e7-c08b-48d1-a9a7-b1e31d237a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'volume_size': 1} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] creating volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] create volume {'name': 'v_b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'is_clone': False, 'name': 'v_b23333e7-c08b-48d1-a9a7-b1e31d237a47'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31d6f95-233f-4de3-83bf-6bd20f8fd2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c9b15b-79a5-4f7b-8d04-744e91bcdc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:33 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Volume volume-b23333e7-c08b-48d1-a9a7-b1e31d237a47 (b23333e7-c08b-48d1-a9a7-b1e31d237a47): created successfully Apr 14 00:04:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66c9b15b-79a5-4f7b-8d04-744e91bcdc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Flow 'volume_create_manager' (6f256577-6f46-40d5-96fd-fc42e6ca6413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:04:33 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f36d88ca-db70-4097-bb80-d93b35280249 tempest-GroupSnapshotsV319Test-1944498755 None] Created volume successfully. Apr 14 00:04:34 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] GroupSnapshot c5c2b413-92d5-4fb8-9c2d-7c307a41c261: creating. Apr 14 00:04:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Group snapshot c5c2b413-92d5-4fb8-9c2d-7c307a41c261: creating. {{(pid=84560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 00:04:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] create snapshot 47f977db-da4d-4e9b-891b-2097d124dd12 for volume b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:04:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] cloning v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 to s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:04:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] create snapshot s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:04:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_47f977db-da4d-4e9b-891b-2097d124dd12'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] create volume s_47f977db-da4d-4e9b-891b-2097d124dd12 from snapshot s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:04:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47@s_47f977db-da4d-4e9b-891b-2097d124dd12', 'is_clone': True, 'full_name': 'Pool-0/s_47f977db-da4d-4e9b-891b-2097d124dd12', 'name': 's_47f977db-da4d-4e9b-891b-2097d124dd12'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] volume s_47f977db-da4d-4e9b-891b-2097d124dd12 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:04:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cf0f51b6-9b37-4812-afee-cdbc6006ac2f tempest-GroupSnapshotsV319Test-1944498755 None] group_snapshot c5c2b413-92d5-4fb8-9c2d-7c307a41c261: created successfully Apr 14 00:04:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a27fe932-f72e-4588-a011-7ce1c7f23a1d tempest-GroupSnapshotsTest-1353205053 None] Group tempest-GroupSnapshotsTest-Group-1772443657: creating Apr 14 00:04:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a27fe932-f72e-4588-a011-7ce1c7f23a1d tempest-GroupSnapshotsTest-1353205053 None] Group tempest-GroupSnapshotsTest-Group-1772443657: created successfully Apr 14 00:04:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a27fe932-f72e-4588-a011-7ce1c7f23a1d tempest-GroupSnapshotsTest-1353205053 None] Create group completed successfully. Apr 14 00:04:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] group_snapshot c5c2b413-92d5-4fb8-9c2d-7c307a41c261: deleting Apr 14 00:04:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] group_snapshot c5c2b413-92d5-4fb8-9c2d-7c307a41c261: deleting {{(pid=84560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 00:04:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] deleating snapshot s_47f977db-da4d-4e9b-891b-2097d124dd12. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:04:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] get snapshots for volume s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:04:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] get volume s_47f977db-da4d-4e9b-891b-2097d124dd12 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47@s_47f977db-da4d-4e9b-891b-2097d124dd12', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_47f977db-da4d-4e9b-891b-2097d124dd12', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432085', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107648', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7465061133114576613', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c0205ff9b2591826', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359361536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78368', 'name': 's_47f977db-da4d-4e9b-891b-2097d124dd12', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] delete snapshot s_47f977db-da4d-4e9b-891b-2097d124dd12 of volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots/s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots/s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (901bdc25-424b-433c-98c0-6d3915c1edae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b1c055-afea-4e1c-9125-fcb33653a6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68b1c055-afea-4e1c-9125-fcb33653a6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538246324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=328034f9-0849-4f60-8399-d7236b131823,host='user@joviandss-2#joviandss-2',id=b4f344c4-7b07-4214-a4a3-284a03b56ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:04:40Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f8d174-2a6d-44b9-890a-0212f9eb6ed1),volume_type_id=96f8d174-2a6d-44b9-890a-0212f9eb6ed1)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9191b5-95fc-426a-8940-e1a6fee796d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9191b5-95fc-426a-8940-e1a6fee796d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbc8d7e-f1ec-4cd3-b945-296b51273276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbc8d7e-f1ec-4cd3-b945-296b51273276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'volume_name': 'volume-b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2353a04-6321-43be-a719-0d6be1864e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2353a04-6321-43be-a719-0d6be1864e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe5b985-ca27-47b3-bdbb-bdadf0d2858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Volume b4f344c4-7b07-4214-a4a3-284a03b56ed9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'volume_size': 1} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] creating volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] create volume {'name': 'v_b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots/s_47f977db-da4d-4e9b-891b-2097d124dd12 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] snapshot s_47f977db-da4d-4e9b-891b-2097d124dd12 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:04:40 user cinder-volume[84560]: WARNING cinder.quota [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-656542182 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-656542182, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:04:40 user cinder-volume[84560]: WARNING cinder.quota [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-656542182 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-656542182, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:04:40 user cinder-volume[84560]: DEBUG cinder.quota [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] Created reservations ['80de7d12-aec6-4e80-bfbb-609037e56ad5', '11f83a94-6777-45cd-b289-878fef1b4f29', '9a0d1635-365a-47cd-88ed-38705f8f59c7', '31dd1181-20f7-4198-97cd-a4176edcc47e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:04:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-092587c2-ddc3-4009-8354-232a0a574acc tempest-GroupSnapshotsV319Test-1944498755 None] group_snapshot c5c2b413-92d5-4fb8-9c2d-7c307a41c261: deleted successfully Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] remove_export for volume: b23333e7-c08b-48d1-a9a7-b1e31d237a47. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1223538497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f712857c-8ab1-4203-8999-40d54113f885,host='user@joviandss-2#joviandss-2',id=b23333e7-c08b-48d1-a9a7-b1e31d237a47,launched_at=2023-04-14T00:04:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbc800e8cad458fb57691ec1a4d652d',provider_auth='CHAP JxePKwNG zByKXVfgbQn4uI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:04:32Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:04:41Z,use_quota=True,user_id='ca8b6288847e445d94958a262e302c8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62e62f30-921c-433e-9b35-39f2d06c902c),volume_type_id=62e62f30-921c-433e-9b35-39f2d06c902c) from target:iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] detach volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 from target iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47/luns/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47/luns/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'is_clone': False, 'name': 'v_b4f344c4-7b07-4214-a4a3-284a03b56ed9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe5b985-ca27-47b3-bdbb-bdadf0d2858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc1a6a4-6f4a-45d9-a4ef-0c02253022e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47/luns/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47/luns/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] failed to remove resource iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 because of JDSS resource v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] delete target: iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] delete target iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:41 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Volume volume-b4f344c4-7b07-4214-a4a3-284a03b56ed9 (b4f344c4-7b07-4214-a4a3-284a03b56ed9): created successfully Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc1a6a4-6f4a-45d9-a4ef-0c02253022e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (901bdc25-424b-433c-98c0-6d3915c1edae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] failed to remove resource iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 because of JDSS resource iqn.2010-10.org.openstack:b23333e7-c08b-48d1-a9a7-b1e31d237a47 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] deleating volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] get snapshots for volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fd012d7d-be5f-4579-938f-3ed6e500f4c5 tempest-GroupSnapshotsTest-1353205053 None] Created volume successfully. Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] get volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432082', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107642', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5046269353100984950', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a245c7a846212869', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359267328', 'san:volume_id': 'a245c7a846212869b6b84a793ab4cd0a7ee63e06', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78221', 'name': 'v_b23333e7-c08b-48d1-a9a7-b1e31d237a47', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] delete volume:v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] GroupSnapshot dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac: creating. Apr 14 00:04:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Group snapshot dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac: creating. {{(pid=84560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 00:04:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] create snapshot 0febb447-b288-4dcf-9ecf-bbd8bea2e760 for volume b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:04:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] cloning v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 to s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:04:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] create snapshot s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:04:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=54,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] volume v_b23333e7-c08b-48d1-a9a7-b1e31d237a47 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:04:45 user cinder-volume[84560]: DEBUG cinder.quota [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Created reservations ['b4fd7d91-2598-44f6-9c78-cbdf2d5934df'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:04:45 user cinder-volume[84560]: WARNING cinder.quota [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-656542182 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-656542182, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:04:45 user cinder-volume[84560]: DEBUG cinder.quota [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Created reservations ['1f42249a-6865-4ab5-80c6-5c45ae8e7d65', '85dacdf8-e947-4b80-995f-cd67a6b5d87f', '512506a4-a46b-40f6-9399-6c9a6e1c4959', 'a2c7ac9c-e48c-4af8-a917-fddd438ed5d4'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_0febb447-b288-4dcf-9ecf-bbd8bea2e760'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] create volume s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 from snapshot s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Geting {'code': 200, 'error': None, 'data': {'available': '114359349248', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:04:47 user cinder-volume[84560]: DEBUG cinder.manager [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:04:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3bea5044-0370-4237-a032-9de57ef792a2 tempest-GroupSnapshotsV319Test-1944498755 None] Delete group completed successfully. Apr 14 00:04:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9@s_0febb447-b288-4dcf-9ecf-bbd8bea2e760', 'is_clone': True, 'full_name': 'Pool-0/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760', 'name': 's_0febb447-b288-4dcf-9ecf-bbd8bea2e760'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] volume s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:04:48 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=69,cinder:UPDATE=26,cinder:DELETE=1,cinder:INSERT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:48 user cinder-volume[84560]: INFO cinder.volume.manager [None req-025cd5fc-d83f-4613-8e77-cb0c2bbce484 tempest-GroupSnapshotsTest-1353205053 None] group_snapshot dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac: created successfully Apr 14 00:04:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] create volume b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 from snapshot 0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:04:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] cloning s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 to v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:04:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] create snapshot v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:04:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] create volume v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 from snapshot v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:04:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760@v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'is_clone': True, 'full_name': 'Pool-0/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'name': 'v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] get volume v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:04:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760@v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432100', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107669', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '439817502594867167', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8ae8b521c17ca701', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359324672', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '76385', 'name': 'v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-106a8a9a-24e2-4547-9e6d-cd16272303f3 tempest-GroupSnapshotsTest-1353205053 None] Create group from source-snapshot-dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac completed successfully. Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] remove_export for volume: b1626d38-5bcc-4a56-93ae-a5f4c1c521e3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:04:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dfd2aed-20bc-4d00-9bd9-86acfff97264,host='user@joviandss-2#joviandss-2',id=b1626d38-5bcc-4a56-93ae-a5f4c1c521e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth='CHAP mXZuKTsA bKmyWzoPCfjQ6v',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=0febb447-b288-4dcf-9ecf-bbd8bea2e760,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:04:52Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f8d174-2a6d-44b9-890a-0212f9eb6ed1),volume_type_id=96f8d174-2a6d-44b9-890a-0212f9eb6ed1) from target:iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] detach volume v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 from target iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/luns/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/luns/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/luns/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/luns/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 because of JDSS resource v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] delete target: iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] delete target iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 because of JDSS resource iqn.2010-10.org.openstack:b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] deleating volume v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] get volume v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760@v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432100', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107669', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '439817502594867167', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8ae8b521c17ca701', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359324672', 'san:volume_id': '8ae8b521c17ca701b13df955836e47620113c999', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '76385', 'name': 'v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] delete snapshot v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 of volume s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots/v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] snapshot v_b1626d38-5bcc-4a56-93ae-a5f4c1c521e3 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.quota [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['145ba334-8a5d-41ce-b181-1ebe0940b50a'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:04:54 user cinder-volume[84560]: WARNING cinder.quota [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1934437767 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1934437767, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:04:54 user cinder-volume[84560]: WARNING cinder.quota [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1934437767 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1934437767, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.quota [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['9c634c3b-0da3-4970-ac78-70a574351a2d', '5d0b140c-07a5-4ddf-8eda-f6e06e8d1aa6', '5d29c7ff-d942-4a26-b485-747d6d9cc26f', 'b88cc7b0-4bb1-44b8-a38b-a1853fb3715b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'available': '114359336960', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.manager [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:04:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d513acd6-10b4-4934-875b-bcaaf7d8122d tempest-GroupSnapshotsTest-1353205053 None] Delete group completed successfully. Apr 14 00:04:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] group_snapshot dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac: deleting Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] group_snapshot dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac: deleting {{(pid=84560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] deleating snapshot s_0febb447-b288-4dcf-9ecf-bbd8bea2e760. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] get volume s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9@s_0febb447-b288-4dcf-9ecf-bbd8bea2e760', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432097', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107663', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8988319318949892445', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cf70654317d943ff', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359336960', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78237', 'name': 's_0febb447-b288-4dcf-9ecf-bbd8bea2e760', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] delete snapshot s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 of volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:04:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots/s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] snapshot s_0febb447-b288-4dcf-9ecf-bbd8bea2e760 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:04:57 user cinder-volume[84560]: WARNING cinder.quota [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1934437767 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1934437767, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:04:57 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=29,cinder:SELECT=64,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:04:57 user cinder-volume[84560]: DEBUG cinder.quota [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['bc72ce35-21f8-46b9-a276-2fb6185823e8', '45dfb97c-97ef-4415-bc24-2f742c659a90', '16edf836-8d03-4f72-bb35-9ada355f0be4', '5ae9ba45-8eef-4b26-850c-978d13acc130'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:04:57 user cinder-volume[84560]: INFO cinder.volume.manager [None req-29686f50-4824-45a7-9757-23a8725a3b6b tempest-GroupSnapshotsTest-1353205053 None] group_snapshot dfe5e79a-3e97-40f2-83c3-9efbdf92d3ac: deleted successfully Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] remove_export for volume: b4f344c4-7b07-4214-a4a3-284a03b56ed9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-538246324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=328034f9-0849-4f60-8399-d7236b131823,host='user@joviandss-2#joviandss-2',id=b4f344c4-7b07-4214-a4a3-284a03b56ed9,launched_at=2023-04-14T00:04:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth='CHAP NCxZwQhr EmfPBWbwHXAYKG',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:04:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:04:58Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96f8d174-2a6d-44b9-890a-0212f9eb6ed1),volume_type_id=96f8d174-2a6d-44b9-890a-0212f9eb6ed1) from target:iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] detach volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 from target iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9/luns/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9/luns/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9/luns/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9/luns/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 because of JDSS resource v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] delete target: iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] delete target iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 because of JDSS resource iqn.2010-10.org.openstack:b4f344c4-7b07-4214-a4a3-284a03b56ed9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] deleating volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] get volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432090', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107656', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6112324393881548075', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '905da59b2d90b1f6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359361536', 'san:volume_id': '905da59b2d90b1f6c60771ed9b4ae2e95584743b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '76372', 'name': 'v_b4f344c4-7b07-4214-a4a3-284a03b56ed9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] delete volume:v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:04:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] volume v_b4f344c4-7b07-4214-a4a3-284a03b56ed9 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['b44bc983-5d4f-4b28-961b-19ab415fcebe'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:00 user cinder-volume[84560]: WARNING cinder.db.sqlalchemy.api [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1934437767'] Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['821e60d5-de88-4817-912b-a79a5f970df8', 'db5ca8bf-bf2d-432c-a76c-821d8965a389', '5542d552-4758-406b-92a4-f5808c4e05bb', '160c2739-d668-47d0-b05d-549abc642be6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=64,cinder:UPDATE=28,cinder:INSERT=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'available': '114359443456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:01 user cinder-volume[84560]: DEBUG cinder.manager [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-62855412-212e-409e-9cfc-59b271940c91 tempest-GroupSnapshotsTest-1353205053 None] Delete group completed successfully. Apr 14 00:05:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9d2b5859-7684-4bbd-a62d-1aa9485a433b tempest-GroupSnapshotsTest-1353205053 None] Group tempest-GroupSnapshotsTest-Group-1666858304: creating Apr 14 00:05:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9d2b5859-7684-4bbd-a62d-1aa9485a433b tempest-GroupSnapshotsTest-1353205053 None] Group tempest-GroupSnapshotsTest-Group-1666858304: created successfully Apr 14 00:05:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9d2b5859-7684-4bbd-a62d-1aa9485a433b tempest-GroupSnapshotsTest-1353205053 None] Create group completed successfully. Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (7999e299-bf3f-4fbc-a303-ee49adeb0a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a5405f-df42-439e-b7f2-347932d21500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7a5405f-df42-439e-b7f2-347932d21500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695636204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf2607ac-e80e-4b69-91d4-83bc07a15652,host='user@joviandss-2#joviandss-2',id=016572e1-35e3-4d29-9839-d3c83b43e831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:03Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a16547-c407-470d-9c87-bfb6a3839aee),volume_type_id=c5a16547-c407-470d-9c87-bfb6a3839aee)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998d9b26-89ab-4c72-b1fa-153376516e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (998d9b26-89ab-4c72-b1fa-153376516e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadd1643-6379-4f2e-a893-66c1d0b42a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fadd1643-6379-4f2e-a893-66c1d0b42a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '016572e1-35e3-4d29-9839-d3c83b43e831', 'volume_name': 'volume-016572e1-35e3-4d29-9839-d3c83b43e831', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb102465-45c7-49b4-bd09-96feaafb7b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb102465-45c7-49b4-bd09-96feaafb7b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68697a3b-6950-49c6-bc58-144cc3db7cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:03 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Volume 016572e1-35e3-4d29-9839-d3c83b43e831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-016572e1-35e3-4d29-9839-d3c83b43e831', 'volume_size': 1} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] creating volume v_016572e1-35e3-4d29-9839-d3c83b43e831. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] create volume {'name': 'v_016572e1-35e3-4d29-9839-d3c83b43e831', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_016572e1-35e3-4d29-9839-d3c83b43e831', 'is_clone': False, 'name': 'v_016572e1-35e3-4d29-9839-d3c83b43e831'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:04 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68697a3b-6950-49c6-bc58-144cc3db7cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-016572e1-35e3-4d29-9839-d3c83b43e831', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:04 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed9cab6-6b1e-4487-9fb3-c6569ebea8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:04 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Volume volume-016572e1-35e3-4d29-9839-d3c83b43e831 (016572e1-35e3-4d29-9839-d3c83b43e831): created successfully Apr 14 00:05:04 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed9cab6-6b1e-4487-9fb3-c6569ebea8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:04 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (7999e299-bf3f-4fbc-a303-ee49adeb0a4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:04 user cinder-volume[84560]: INFO cinder.volume.manager [None req-75a4f5bc-3b46-4aab-978b-13eb0252b6d5 tempest-GroupSnapshotsTest-1353205053 None] Created volume successfully. Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (ea28b8b3-8d58-4ba6-a84b-d59a577cdcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22190c60-b063-433d-9cfb-6e25bac257d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22190c60-b063-433d-9cfb-6e25bac257d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1850807687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a3323a-058c-4e1d-8627-04fbfb2310bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:05Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb4747b-df93-4aca-b03b-5d49a05d34c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb4747b-df93-4aca-b03b-5d49a05d34c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a09c6e-33d2-4e86-a7c3-638de1a10b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a09c6e-33d2-4e86-a7c3-638de1a10b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'volume_name': 'volume-f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77258c63-016c-40e6-b622-f4f56dd9c0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77258c63-016c-40e6-b622-f4f56dd9c0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dfbe87-e5ed-49da-bd31-f8452fd22814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:05 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume f1a3323a-058c-4e1d-8627-04fbfb2310bd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Cloning f1a3323a-058c-4e1d-8627-04fbfb2310bd from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Preparing cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 00:05:05 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (e08950a9-7486-47fb-b792-723b4f2dfe9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4c9b58-eb49-41ee-9708-4d55fa8b29c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d4c9b58-eb49-41ee-9708-4d55fa8b29c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2089430681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf2607ac-e80e-4b69-91d4-83bc07a15652,host='user@joviandss-2#joviandss-2',id=629a0cf2-6cfa-49d7-8765-9d86ce8239c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:06Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a16547-c407-470d-9c87-bfb6a3839aee),volume_type_id=c5a16547-c407-470d-9c87-bfb6a3839aee)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b597493-58b2-4e0e-b87d-61e7a022e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b597493-58b2-4e0e-b87d-61e7a022e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c179cf-309c-465b-850f-86c60c039786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c179cf-309c-465b-850f-86c60c039786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'volume_name': 'volume-629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d25921e-2c9c-43c1-a1c9-631222addd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d25921e-2c9c-43c1-a1c9-631222addd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dd8919-59a1-4998-a49f-fe35e3b6dc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:06 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Volume 629a0cf2-6cfa-49d7-8765-9d86ce8239c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'volume_size': 1} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] creating volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] create volume {'name': 'v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:06 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2, size 15.55 MB, duration 1.00 sec {{(pid=84560) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 00:05:06 user cinder-volume[84560]: INFO cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Image download 15.55 MB at 15.55 MB/s Apr 14 00:05:06 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:06 user sudo[91374]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 Apr 14 00:05:06 user sudo[91374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'is_clone': False, 'name': 'v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45dd8919-59a1-4998-a49f-fe35e3b6dc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8660be-00ec-415f-b277-c1feb3cdb41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:07 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Volume volume-629a0cf2-6cfa-49d7-8765-9d86ce8239c2 (629a0cf2-6cfa-49d7-8765-9d86ce8239c2): created successfully Apr 14 00:05:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8660be-00ec-415f-b277-c1feb3cdb41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (e08950a9-7486-47fb-b792-723b4f2dfe9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8068e488-3070-4783-8640-4ba12c93b14a tempest-GroupSnapshotsTest-1353205053 None] Created volume successfully. Apr 14 00:05:07 user sudo[91374]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:07 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2" returned: 0 in 0.938s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:07 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Temporary image 6db62068-7278-4cd8-b41f-d0140d89e199 is fetched for user f5613db231764f7c8c2ac461cf751d8e. {{(pid=84560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 00:05:07 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:07 user sudo[91401]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 Apr 14 00:05:07 user sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:08 user sudo[91401]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:08 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2" returned: 0 in 0.789s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] creating volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] create volume {'name': 'v_f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:08 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cadf50be-0b7c-4e89-86e1-708dafa1cb46 tempest-GroupSnapshotsTest-1353205053 None] Update group completed successfully. Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'is_clone': False, 'name': 'v_f1a3323a-058c-4e1d-8627-04fbfb2310bd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Attempting download of 6db62068-7278-4cd8-b41f-d0140d89e199 ((None, None)) to volume f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] copy_image_to_volume volume-f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 00:05:08 user cinder-volume[84560]: DEBUG os_brick.utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:05:08 user cinder-volume[84560]: INFO oslo.privsep.daemon [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpcfnc2oez/privsep.sock'] Apr 14 00:05:08 user sudo[91440]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpcfnc2oez/privsep.sock Apr 14 00:05:08 user sudo[91440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e350b4de-f34b-4d4b-a65c-b0d392916309 tempest-GroupSnapshotsTest-1353205053 None] Update group completed successfully. Apr 14 00:05:10 user sudo[91440]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:10 user cinder-volume[84560]: INFO oslo.privsep.daemon [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Spawned new privsep daemon via rootwrap Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Accepted privsep connection to /tmp/tmpcfnc2oez/privsep.sock {{(pid=84560) __init__ /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:362}} Apr 14 00:05:10 user cinder-volume[84560]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 14 00:05:10 user cinder-volume[84560]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 14 00:05:10 user cinder-volume[84560]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none Apr 14 00:05:10 user cinder-volume[84560]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 91493 Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9584a930-01a0-480a-8a0a-ad71e557b7d3]: (2,) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:10 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6d3037e6-8e28-4343-80bb-9446bd308efa tempest-GroupSnapshotsTest-1353205053 None] Update group completed successfully. Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a18c1-2f9e-4cb4-9e43-086165809e0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:10 user cinder-volume[84560]: WARNING os_brick.initiator.connectors.nvmeof [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5855381e-bcb6-4785-ac13-a6c3a80b6cce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174e5bf-2e53-4e68-94e9-0c4e1e983f34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ebb4ae-c9bd-42a1-87bb-2204dd35e867]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): nvme version {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] 'nvme version' failed. Not Retrying. {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] nvme not present on system {{(pid=84560) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 00:05:10 user cinder-volume[84560]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 00:05:10 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4ee3aa-6b9f-4c05-864e-d19734595025]: (4, '') {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=84560) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=84560) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] LIGHTOS: no hostnqn found. {{(pid=84560) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG os_brick.utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] <== get_connector_properties: return (2045ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume f1a3323a-058c-4e1d-8627-04fbfb2310bd: creating export {{(pid=84560) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] create export for volume: f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] ensure volume f1a3323a-058c-4e1d-8627-04fbfb2310bd assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] check if targe iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] create target and attach volume f1a3323a-058c-4e1d-8627-04fbfb2310bd to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:05:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] create target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:05:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:12 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f01bf55d-0518-4a4a-907c-be3ee77054a8 tempest-GroupSnapshotsTest-1353205053 None] Update group completed successfully. Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Flow 'volume_create_manager' (95c45a8a-e0c5-4fc4-83c9-5bd46b9d9d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2807c1-d698-4959-b8d1-ffd967267cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c2807c1-d698-4959-b8d1-ffd967267cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-150766836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c7267b8e-f20c-4625-b82d-b1a31a337714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:12Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059688cf-08d9-456a-a98e-b1466b98c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (059688cf-08d9-456a-a98e-b1466b98c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ae8682-7734-4ee3-af47-5e3ca722ea17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ae8682-7734-4ee3-af47-5e3ca722ea17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7267b8e-f20c-4625-b82d-b1a31a337714', 'volume_name': 'volume-c7267b8e-f20c-4625-b82d-b1a31a337714', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f33666f-1b5e-4ffc-aa15-95f0403f8ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f33666f-1b5e-4ffc-aa15-95f0403f8ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d858f739-1cd7-4fe7-a37a-e05a497c7715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:12 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Volume c7267b8e-f20c-4625-b82d-b1a31a337714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7267b8e-f20c-4625-b82d-b1a31a337714', 'volume_size': 1} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] creating volume v_c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] create volume {'name': 'v_c7267b8e-f20c-4625-b82d-b1a31a337714', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c7267b8e-f20c-4625-b82d-b1a31a337714', 'is_clone': False, 'name': 'v_c7267b8e-f20c-4625-b82d-b1a31a337714'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d858f739-1cd7-4fe7-a37a-e05a497c7715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7267b8e-f20c-4625-b82d-b1a31a337714', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3fe5c0-9475-415c-b51f-ff336ab90e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=70,cinder:UPDATE=26,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:13 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Volume volume-c7267b8e-f20c-4625-b82d-b1a31a337714 (c7267b8e-f20c-4625-b82d-b1a31a337714): created successfully Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3fe5c0-9475-415c-b51f-ff336ab90e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Flow 'volume_create_manager' (95c45a8a-e0c5-4fc4-83c9-5bd46b9d9d90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a2442b4d-2605-4038-a45d-4103e82c89e8 tempest-TestVolumeSwap-882310266 None] Created volume successfully. Apr 14 00:05:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] GroupSnapshot d70812f7-11dd-42f7-ba2a-0d0f020b3970: creating. Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Group snapshot d70812f7-11dd-42f7-ba2a-0d0f020b3970: creating. {{(pid=84560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] create snapshot d756a700-c3ef-487e-8357-6740fd33d0b7 for volume 016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] cloning v_016572e1-35e3-4d29-9839-d3c83b43e831 to s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] create snapshot s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] atach volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd to target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:05:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_d756a700-c3ef-487e-8357-6740fd33d0b7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] create volume s_d756a700-c3ef-487e-8357-6740fd33d0b7 from snapshot s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Flow 'volume_create_manager' (745f6803-720b-40b0-90b9-bc2e892d3aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f073c3a8-6509-4b3a-842c-aa2ca39dcf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f073c3a8-6509-4b3a-842c-aa2ca39dcf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1546552654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2024a461-c307-42e0-976a-bde8b1ef0bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:15Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68e4305-7019-4dfa-af4d-dc5796de74b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d68e4305-7019-4dfa-af4d-dc5796de74b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94ecddd-db31-4c77-8479-91c4038ea2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94ecddd-db31-4c77-8479-91c4038ea2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2024a461-c307-42e0-976a-bde8b1ef0bed', 'volume_name': 'volume-2024a461-c307-42e0-976a-bde8b1ef0bed', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76fd979-1b93-4477-8680-2df650b6ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76fd979-1b93-4477-8680-2df650b6ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540a1a71-9984-47ad-833d-d89c2b73b6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:15 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Volume 2024a461-c307-42e0-976a-bde8b1ef0bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2024a461-c307-42e0-976a-bde8b1ef0bed', 'volume_size': 1} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] creating volume v_2024a461-c307-42e0-976a-bde8b1ef0bed. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] create volume {'name': 'v_2024a461-c307-42e0-976a-bde8b1ef0bed', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_016572e1-35e3-4d29-9839-d3c83b43e831@s_d756a700-c3ef-487e-8357-6740fd33d0b7', 'is_clone': True, 'full_name': 'Pool-0/s_d756a700-c3ef-487e-8357-6740fd33d0b7', 'name': 's_d756a700-c3ef-487e-8357-6740fd33d0b7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] volume s_d756a700-c3ef-487e-8357-6740fd33d0b7 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] create snapshot eb9c93b6-6e8d-437f-9067-a69572f2e9e8 for volume 629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] cloning v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 to s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] create snapshot s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3865326636663330', 'lun': 0, 'mode': 'wt', 'name': 'v_f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'prod_id': 'Storage', 'scsi_id': '8e2f6f3044c1a3e4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] add credentails to target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2024a461-c307-42e0-976a-bde8b1ef0bed', 'is_clone': False, 'name': 'v_2024a461-c307-42e0-976a-bde8b1ef0bed'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540a1a71-9984-47ad-833d-d89c2b73b6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2024a461-c307-42e0-976a-bde8b1ef0bed', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35247a52-04fb-4b62-973c-effac05e203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Volume volume-2024a461-c307-42e0-976a-bde8b1ef0bed (2024a461-c307-42e0-976a-bde8b1ef0bed): created successfully Apr 14 00:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35247a52-04fb-4b62-973c-effac05e203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Flow 'volume_create_manager' (745f6803-720b-40b0-90b9-bc2e892d3aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:17 user cinder-volume[84560]: INFO cinder.volume.manager [None req-79c89291-89e2-4553-ad93-565f226cb2eb tempest-TestVolumeSwap-882310266 None] Created volume successfully. Apr 14 00:05:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': {'name': 'tyRSPHDJ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] initialize_connection for f1a3323a-058c-4e1d-8627-04fbfb2310bd 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connector [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Factory for iscsi on None {{(pid=84560) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyRSPHDJ', 'auth_password': '***', 'target_lun': False}}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.009s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:05:17 user cinder-volume[84560]: INFO os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260" returned: 21 in 0.058s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56a9d7-5d2f-45f4-a812-a90aa229c67c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 00:05:17 user cinder-volume[84560]: {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --interface default --op new {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.065s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3b2297-06c3-4a43-ac5a-16b972c1b140]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd] added\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd] added Apr 14 00:05:17 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcfc27d-0778-4c76-8012-950af201c8c8]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f0a87c-9539-42f9-ace4-f02c14c5792b]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyRSPHDJ {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tyRSPHDJ" returned: 0 in 0.029s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6d6565-eefc-4ab6-875b-7540d5eec808]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tyRSPHDJ'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[48218aef-0c03-4239-8bb2-788d10e0a0a9]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.040s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4c9f77-6c90-4288-831f-25c2fd809070]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Apr 14 00:05:17 user cinder-volume[84560]: {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsi session list stdout= stderr=iscsiadm: No active sessions. Apr 14 00:05:17 user cinder-volume[84560]: {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:05:17 user cinder-volume[84560]: WARNING os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Apr 14 00:05:17 user cinder-volume[84560]: Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --login {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --login" returned: 0 in 0.130s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810d81c-d474-4ab0-8719-08b9a973fea1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260] Apr 14 00:05:17 user cinder-volume[84560]: Login to [iface: default, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260] successful. Apr 14 00:05:17 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7448d1b-55c3-44d0-96be-16ca2d3e40a3]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c0bd60-a716-44ab-a165-4baff96520d1]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd (non-flash) Apr 14 00:05:17 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd (non-flash) Apr 14 00:05:17 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.535s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Connected to 172.16.0.220:3260 {{(pid=84560) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] HCTL ('33', '-', '-', 0) found on session 1 with lun 0 {{(pid=84560) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Scanning host 33 c: -, t: -, l: 0) {{(pid=84560) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b81ae7-df07-49b8-9bfe-c73f637e3421]: (4, ('- - 0', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Searching for a device in session 1 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=84560) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 00:05:17 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyRSPHDJ', 'auth_password': '***', 'target_lun': False} {{(pid=84560) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_eb9c93b6-6e8d-437f-9067-a69572f2e9e8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] create volume s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 from snapshot s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.592s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] <== connect_volume: return (1601ms) {'type': 'block', 'scsi_wwn': '23865326636663330', 'path': '/dev/sdb'} {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdb of=/dev/null count=1 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdb of=/dev/null count=1" returned: 0 in 0.025s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:18 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd13bd-32b5-48ea-8db7-25b4eefda0c4]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00250031 s, 205 kB/s\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:19 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_6db62068-7278-4cd8-b41f-d0140d89e199_c9u_u6fj {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:19 user sudo[91837]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_6db62068-7278-4cd8-b41f-d0140d89e199_c9u_u6fj Apr 14 00:05:19 user sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2@s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8', 'is_clone': True, 'full_name': 'Pool-0/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8', 'name': 's_eb9c93b6-6e8d-437f-9067-a69572f2e9e8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] volume s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:05:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2d596478-f188-4e8e-9421-a37d46e922f7 tempest-GroupSnapshotsTest-1353205053 None] group_snapshot d70812f7-11dd-42f7-ba2a-0d0f020b3970: created successfully Apr 14 00:05:20 user sudo[91837]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:20 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_6db62068-7278-4cd8-b41f-d0140d89e199_c9u_u6fj" returned: 0 in 1.449s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:20 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:20 user sudo[91931]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 Apr 14 00:05:20 user sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] group_snapshot d70812f7-11dd-42f7-ba2a-0d0f020b3970: deleting Apr 14 00:05:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] group_snapshot d70812f7-11dd-42f7-ba2a-0d0f020b3970: deleting {{(pid=84560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 00:05:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] deleating snapshot s_d756a700-c3ef-487e-8357-6740fd33d0b7. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:05:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] get volume s_d756a700-c3ef-487e-8357-6740fd33d0b7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_016572e1-35e3-4d29-9839-d3c83b43e831@s_d756a700-c3ef-487e-8357-6740fd33d0b7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_d756a700-c3ef-487e-8357-6740fd33d0b7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432125', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107699', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16092733310006259154', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '08a3d4b4073e9911', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114359009280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78401', 'name': 's_d756a700-c3ef-487e-8357-6740fd33d0b7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] delete snapshot s_d756a700-c3ef-487e-8357-6740fd33d0b7 of volume v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots/s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots/s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:21 user sudo[91931]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:21 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2" returned: 0 in 1.382s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] 6db62068-7278-4cd8-b41f-d0140d89e199 was qcow2, converting to raw {{(pid=84560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 00:05:21 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 of=/dev/sdb oflag=direct {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:21 user sudo[91962]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 of=/dev/sdb oflag=direct Apr 14 00:05:21 user sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114359009280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Flow 'volume_create_manager' (075b355d-9d00-428a-81dd-5bbe22ac78a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5230ad9-d40b-4850-b156-b5ad6d10f9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5230ad9-d40b-4850-b156-b5ad6d10f9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1314603800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2509f860-ef4a-443f-9fc8-171e0df13a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ee7b5626a14c69aefa86192b6e7bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:23Z,use_quota=True,user_id='38f9a13bd3f74842b61b57b2ea8bf025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7006e8-bbe9-46ad-a584-c3e4eef29b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa7006e8-bbe9-46ad-a584-c3e4eef29b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2a18cb-0d4c-43c6-883b-5d764b84e838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2a18cb-0d4c-43c6-883b-5d764b84e838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2509f860-ef4a-443f-9fc8-171e0df13a7a', 'volume_name': 'volume-2509f860-ef4a-443f-9fc8-171e0df13a7a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515eb2bb-0914-45cb-86ed-1e8b95eca1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515eb2bb-0914-45cb-86ed-1e8b95eca1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838e8cfe-0841-43e9-99ac-7a759848270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:22 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Volume 2509f860-ef4a-443f-9fc8-171e0df13a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2509f860-ef4a-443f-9fc8-171e0df13a7a', 'volume_size': 1} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] creating volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] create volume {'name': 'v_2509f860-ef4a-443f-9fc8-171e0df13a7a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:23 user sudo[91962]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:23 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 of=/dev/sdb oflag=direct" returned: 0 in 1.209s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:23 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 /dev/sdb {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:23 user sudo[92005]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 /dev/sdb Apr 14 00:05:23 user sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots/s_d756a700-c3ef-487e-8357-6740fd33d0b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] snapshot s_d756a700-c3ef-487e-8357-6740fd33d0b7 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] deleating snapshot s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] get volume s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Flow 'volume_create_manager' (b832a1b0-542b-4e68-9673-c04e38cdc006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce06f5f6-4aa3-40ed-9094-1f4d0deb4cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2@s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432127', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107713', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12013329930823021442', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '80691805f47486eb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114358964224', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78862', 'name': 's_eb9c93b6-6e8d-437f-9067-a69572f2e9e8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] delete snapshot s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 of volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_2509f860-ef4a-443f-9fc8-171e0df13a7a', 'is_clone': False, 'name': 'v_2509f860-ef4a-443f-9fc8-171e0df13a7a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838e8cfe-0841-43e9-99ac-7a759848270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2509f860-ef4a-443f-9fc8-171e0df13a7a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d187d1-0670-4294-b5c5-7f4213a2b319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce06f5f6-4aa3-40ed-9094-1f4d0deb4cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-759988822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4e932259-c14a-4645-beb4-db5dba541f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3532e77f484340bab1e4512b525f1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:24Z,use_quota=True,user_id='c1c752aef8934c649d496f3fd9ffec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa902cee-c56a-4b56-adf5-62a28a1b9a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa902cee-c56a-4b56-adf5-62a28a1b9a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd8abeb-fb02-4f69-be54-f069e40ae9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bd8abeb-fb02-4f69-be54-f069e40ae9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e932259-c14a-4645-beb4-db5dba541f58', 'volume_name': 'volume-4e932259-c14a-4645-beb4-db5dba541f58', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5b8ef1-1c28-4fc5-a0d3-4e4bc8b6dde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5b8ef1-1c28-4fc5-a0d3-4e4bc8b6dde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67567470-65a8-4847-8435-5cc8e1ccf0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Volume 4e932259-c14a-4645-beb4-db5dba541f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e932259-c14a-4645-beb4-db5dba541f58', 'volume_size': 1} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] creating volume v_4e932259-c14a-4645-beb4-db5dba541f58. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] create volume {'name': 'v_4e932259-c14a-4645-beb4-db5dba541f58', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Volume volume-2509f860-ef4a-443f-9fc8-171e0df13a7a (2509f860-ef4a-443f-9fc8-171e0df13a7a): created successfully Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d187d1-0670-4294-b5c5-7f4213a2b319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Flow 'volume_create_manager' (075b355d-9d00-428a-81dd-5bbe22ac78a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:24 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ca650344-5e27-441d-aa90-a4c572c13e6a tempest-TaggedAttachmentsTest-694590407 None] Created volume successfully. Apr 14 00:05:25 user sudo[92005]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 /dev/sdb" returned: 0 in 2.214s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:25 user sudo[92099]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2 Apr 14 00:05:25 user sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4e932259-c14a-4645-beb4-db5dba541f58', 'is_clone': False, 'name': 'v_4e932259-c14a-4645-beb4-db5dba541f58'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67567470-65a8-4847-8435-5cc8e1ccf0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e932259-c14a-4645-beb4-db5dba541f58', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cec53b-4578-467a-b9f7-9f184362dc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Volume volume-4e932259-c14a-4645-beb4-db5dba541f58 (4e932259-c14a-4645-beb4-db5dba541f58): created successfully Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cec53b-4578-467a-b9f7-9f184362dc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Flow 'volume_create_manager' (b832a1b0-542b-4e68-9673-c04e38cdc006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5d9377b1-fa32-4768-a339-c078b697eba7 tempest-VolumesListAdminTestJSON-780914272 None] Created volume successfully. Apr 14 00:05:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=73,cinder:UPDATE=26,cinder:INSERT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots/s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] snapshot s_eb9c93b6-6e8d-437f-9067-a69572f2e9e8 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:05:26 user cinder-volume[84560]: WARNING cinder.quota [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1526482602 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1526482602, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:26 user cinder-volume[84560]: WARNING cinder.quota [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1526482602 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1526482602, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.quota [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['0b02b550-7fa2-493c-aa89-9571c2410e65', 'a65420f6-0cf7-44ce-ae5d-49b54e9548e5', '9b9a9cb7-9e61-49e7-a601-b77a450f92f1', '1c47656d-3a5c-4aa8-9dd8-44ad10d9617f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:26 user sudo[92099]: pam_unix(sudo:session): session closed for user root Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2" returned: 0 in 1.489s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6db62068-7278-4cd8-b41f-d0140d89e199_vde7gn85user@joviandss-2, size 112.00 MB, duration 2.22 sec, destination /dev/sdb {{(pid=84560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 00:05:26 user cinder-volume[84560]: INFO cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Converted 112.00 MB image at 50.52 MB/s Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tyRSPHDJ', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23865326636663330', 'path': '/dev/sdb'}), 'kwargs': {'force': False}}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c2a11f-14fa-48b0-8531-e9d042f8fb2a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 00:05:26 user cinder-volume[84560]: No targets found. Apr 14 00:05:26 user cinder-volume[84560]: iSNS: Apr 14 00:05:26 user cinder-volume[84560]: No targets found. Apr 14 00:05:26 user cinder-volume[84560]: STATIC: Apr 14 00:05:26 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd Apr 14 00:05:26 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:05:26 user cinder-volume[84560]: Iface Name: default Apr 14 00:05:26 user cinder-volume[84560]: FIRMWARE: Apr 14 00:05:26 user cinder-volume[84560]: No targets found. Apr 14 00:05:26 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 00:05:26 user cinder-volume[84560]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 00:05:26 user cinder-volume[84560]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=84560) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd', 0)] {{(pid=84560) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG cinder.quota [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['5ac1b945-b28b-4b7c-be52-3bc24922aa8d', 'db39200a-d4fe-4367-9e44-29792ded006d', '5c0d3e7b-8d8f-4427-85b1-4ef1873794c8', '79a85179-dd31-411f-af16-e428e9f75de6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.052s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b2b8c-f34c-4620-be36-9db6c7e6bdbc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d51009c-2a88-4d30-b6db-9e71ddf73298]: (4, ('tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('-m', 'session'): stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd (non-flash) Apr 14 00:05:26 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsi session list stdout=tcp: [1] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd (non-flash) Apr 14 00:05:26 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Resulting device map defaultdict(. at 0x7fdcc7dd8e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd'): ({'sdb'}, set())}) {{(pid=84560) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Removing single pathed devices sdb {{(pid=84560) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 00:05:26 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.051s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd080c24-a87d-4657-853b-ee35dbe1d0df]: (4, ('path checker states:\nup 1\n\npaths: 0\nbusy: False\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7755523c-6066-4ee8-9928-e162527f8223 tempest-GroupSnapshotsTest-1353205053 None] group_snapshot d70812f7-11dd-42f7-ba2a-0d0f020b3970: deleted successfully Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.035s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84a9dbc-16ff-46e3-a538-bd3e55008059]: (4, ('ok\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Flushing IO for device /dev/sdb {{(pid=84560) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.034s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07326b1-35c9-4dd6-b56b-b265d9bcab13]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=84560) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.071s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f30eb4d-cb06-4d54-a618-a4cc772abbe9]: (4, ('1', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=84560) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] SCSI volumes sdb have been removed. {{(pid=84560) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd')] {{(pid=84560) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.042s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9ce28d-7f7b-4c87-b942-02bd2159bcd9]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --logout {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b44ba5-fb55-4430-9f43-4ab8e04d093c]: (4, ('Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260]\nLogout of [sid: 1, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 1, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260] Apr 14 00:05:27 user cinder-volume[84560]: Logout of [sid: 1, target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd, portal: 172.16.0.220,3260] successful. Apr 14 00:05:27 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op delete {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0702384a-3136-4297-9008-f0d8faa7f175]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.577s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] <== disconnect_volume: return (578ms) None {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] terminate connection for f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] volume f1a3323a-058c-4e1d-8627-04fbfb2310bd: removing export {{(pid=84560) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] remove_export for volume: f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1850807687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a3323a-058c-4e1d-8627-04fbfb2310bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth='CHAP tyRSPHDJ wjBE9SrzQ53p2q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T00:05:05Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] detach volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd from target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Flow 'volume_create_manager' (47c9fc48-1073-4d33-abb9-159c32fb0672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22fd7f5-cd0d-402a-9f01-4d7e486b0ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e22fd7f5-cd0d-402a-9f01-4d7e486b0ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1194875063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7510f1f-a05d-4935-aa83-033a3dfc7fb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3532e77f484340bab1e4512b525f1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:27Z,use_quota=True,user_id='c1c752aef8934c649d496f3fd9ffec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fff6487-3fd8-4f70-9f60-cb82e41af6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fff6487-3fd8-4f70-9f60-cb82e41af6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba17b9-e3c5-4b3b-b0e6-1b9713fdf8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba17b9-e3c5-4b3b-b0e6-1b9713fdf8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'volume_name': 'volume-a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735e650f-3bef-4b3f-9133-ee4541c8dc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735e650f-3bef-4b3f-9133-ee4541c8dc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448831fa-f268-49d3-8da9-2e41501db0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:27 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Volume a7510f1f-a05d-4935-aa83-033a3dfc7fb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'volume_size': 1} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] creating volume v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] create volume {'name': 'v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] remove_export for volume: 016572e1-35e3-4d29-9839-d3c83b43e831. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-695636204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf2607ac-e80e-4b69-91d4-83bc07a15652,host='user@joviandss-2#joviandss-2',id=016572e1-35e3-4d29-9839-d3c83b43e831,launched_at=2023-04-14T00:05:05Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth='CHAP ozUMVSwB us1iBRWXHYr23C',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:03Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:05:27Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a16547-c407-470d-9c87-bfb6a3839aee),volume_type_id=c5a16547-c407-470d-9c87-bfb6a3839aee) from target:iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] detach volume v_016572e1-35e3-4d29-9839-d3c83b43e831 from target iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831/luns/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831/luns/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831/luns/v_016572e1-35e3-4d29-9839-d3c83b43e831'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831/luns/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 because of JDSS resource v_016572e1-35e3-4d29-9839-d3c83b43e831 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] delete target: iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] delete target iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 because of JDSS resource iqn.2010-10.org.openstack:016572e1-35e3-4d29-9839-d3c83b43e831 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] deleating volume v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] delete target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] delete target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Downloaded image 6db62068-7278-4cd8-b41f-d0140d89e199 ((None, None)) to volume f1a3323a-058c-4e1d-8627-04fbfb2310bd successfully. {{(pid=84560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Temporary image 6db62068-7278-4cd8-b41f-d0140d89e199 for user f5613db231764f7c8c2ac461cf751d8e is deleted. {{(pid=84560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 00:05:28 user cinder-volume[84560]: WARNING cinder.quota [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Deprecated: Default quota for resource: volumes_joviandss-2 is set by the default quota flag: quota_volumes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:28 user cinder-volume[84560]: WARNING cinder.quota [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Deprecated: Default quota for resource: gigabytes_joviandss-2 is set by the default quota flag: quota_gigabytes_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:28 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=67,cinder:DELETE=4,cinder:UPDATE=20,cinder:INSERT=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] get volume v_016572e1-35e3-4d29-9839-d3c83b43e831 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.quota [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Created reservations ['09301132-23f7-414b-8280-f48408fabf20', '4a2293e0-fcd1-47d2-90d3-546332ed153e', 'b5913575-353e-4383-8f34-e31980dbfbce', '079df109-b79c-4e51-aeed-9727d9a62c32'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Creating image volume entry: {'display_name': 'image-6db62068-7278-4cd8-b41f-d0140d89e199', 'deleted': False, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd 0', 'replication_driver_data': None, 'volume_type_id': 'e4897ac4-9a58-4946-a239-ab48566b0a8c', 'volume_metadata': [], 'size': 1, 'terminated_at': None, 'provider_id': None, 'launched_at': None, 'previous_status': None, 'user_id': 'f5613db231764f7c8c2ac461cf751d8e', 'host': 'user@joviandss-2#joviandss-2', 'availability_zone': 'nova', 'provider_auth': 'CHAP tyRSPHDJ wjBE9SrzQ53p2q', 'encryption_key_id': None, 'ec2_id': None, 'replication_status': None, 'replication_extended_status': None, 'service_uuid': None, 'provider_geometry': None, 'multiattach': False, 'display_description': None, 'consistencygroup_id': None, 'volume_admin_metadata': [], 'bootable': False, 'updated_at': datetime.datetime(2023, 4, 14, 0, 5, 5, tzinfo=datetime.timezone.utc), 'project_id': '1c8fe019fcbc488f9d8248e0eca402ee', 'group_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'created_at': datetime.datetime(2023, 4, 14, 0, 5, 5, tzinfo=datetime.timezone.utc), 'cluster_name': None, 'scheduled_at': datetime.datetime(2023, 4, 14, 0, 5, 5, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'shared_targets': True, 'metadata': {}, 'attach_status': 'detached', 'status': 'creating', 'source_volid': 'f1a3323a-058c-4e1d-8627-04fbfb2310bd'}. {{(pid=84560) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_016572e1-35e3-4d29-9839-d3c83b43e831', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432113', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107681', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7835068961591012984', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'dd040b2c88b6b770', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342572032', 'san:volume_id': 'dd040b2c88b6b7705396c95a33c06a469e76ec70', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78379', 'name': 'v_016572e1-35e3-4d29-9839-d3c83b43e831', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] delete volume:v_016572e1-35e3-4d29-9839-d3c83b43e831 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'is_clone': False, 'name': 'v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (448831fa-f268-49d3-8da9-2e41501db0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9473e5-037c-44b9-9662-d95a7b7384a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Volume volume-a7510f1f-a05d-4935-aa83-033a3dfc7fb9 (a7510f1f-a05d-4935-aa83-033a3dfc7fb9): created successfully Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c9473e5-037c-44b9-9662-d95a7b7384a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Flow 'volume_create_manager' (47c9fc48-1073-4d33-abb9-159c32fb0672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:28 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7b8db7a0-1d29-4ff5-a103-acc2481f61f4 tempest-VolumesListAdminTestJSON-780914272 None] Created volume successfully. Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume reschedule parameters: False retry: None {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (2f82ffee-0546-4561-982b-508b1c3d5fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5b7254-d708-4abb-ac3c-58557bca064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5b7254-d708-4abb-ac3c-58557bca064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='image-6db62068-7278-4cd8-b41f-d0140d89e199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=27b4700f-a1b7-4450-8b39-5270a460f507,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8fe019fcbc488f9d8248e0eca402ee',provider_auth='CHAP tyRSPHDJ wjBE9SrzQ53p2q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f1a3323a-058c-4e1d-8627-04fbfb2310bd,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:05Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d63b3a-6c12-4f24-9e69-e86887d65538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d63b3a-6c12-4f24-9e69-e86887d65538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cdc450-4dab-445c-a294-a0f1e9920206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cdc450-4dab-445c-a294-a0f1e9920206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'volume_name': 'volume-27b4700f-a1b7-4450-8b39-5270a460f507', 'volume_size': 1, 'source_volid': 'f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'source_volstatus': 'downloading'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e7ac50-b1ed-4d4c-80d3-a8015a05d431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48e7ac50-b1ed-4d4c-80d3-a8015a05d431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94bf6f7-2e85-4aa1-b84b-c700b346321a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume 27b4700f-a1b7-4450-8b39-5270a460f507: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-27b4700f-a1b7-4450-8b39-5270a460f507', 'volume_size': 1, 'source_volid': 'f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'source_volstatus': 'downloading'} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] cloned volume f1a3323a-058c-4e1d-8627-04fbfb2310bd to 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] cloning v_f1a3323a-058c-4e1d-8627-04fbfb2310bd to v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] create snapshot v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Flow 'volume_create_manager' (5efb954e-6da6-43ed-b827-b6d5f961a2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d4f02f-0cba-4132-a877-bab30625fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d4f02f-0cba-4132-a877-bab30625fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2060137070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4afdbef5-8050-47b0-bc7d-67da76a2695e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3532e77f484340bab1e4512b525f1cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:30Z,use_quota=True,user_id='c1c752aef8934c649d496f3fd9ffec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b089b5d6-122c-4f54-b223-834dbec6219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b089b5d6-122c-4f54-b223-834dbec6219f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a2ed68-607c-46ac-920c-2b83b0c6383e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a2ed68-607c-46ac-920c-2b83b0c6383e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4afdbef5-8050-47b0-bc7d-67da76a2695e', 'volume_name': 'volume-4afdbef5-8050-47b0-bc7d-67da76a2695e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c0cc4c-c82b-4707-9f36-a7d702b4fa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c0cc4c-c82b-4707-9f36-a7d702b4fa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40760213-9224-413f-810f-c438ca994fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:30 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Volume 4afdbef5-8050-47b0-bc7d-67da76a2695e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4afdbef5-8050-47b0-bc7d-67da76a2695e', 'volume_size': 1} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] creating volume v_4afdbef5-8050-47b0-bc7d-67da76a2695e. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] create volume {'name': 'v_4afdbef5-8050-47b0-bc7d-67da76a2695e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_27b4700f-a1b7-4450-8b39-5270a460f507'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] create volume v_27b4700f-a1b7-4450-8b39-5270a460f507 from snapshot v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_016572e1-35e3-4d29-9839-d3c83b43e831 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] volume v_016572e1-35e3-4d29-9839-d3c83b43e831 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] remove_export for volume: 629a0cf2-6cfa-49d7-8765-9d86ce8239c2. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2089430681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cf2607ac-e80e-4b69-91d4-83bc07a15652,host='user@joviandss-2#joviandss-2',id=629a0cf2-6cfa-49d7-8765-9d86ce8239c2,launched_at=2023-04-14T00:05:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth='CHAP wBPCGijo 6U7WgoCI83xYvJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:06Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:05:28Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5a16547-c407-470d-9c87-bfb6a3839aee),volume_type_id=c5a16547-c407-470d-9c87-bfb6a3839aee) from target:iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] detach volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 from target iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2/luns/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2/luns/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2/luns/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2/luns/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 because of JDSS resource v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] delete target: iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] delete target iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 because of JDSS resource iqn.2010-10.org.openstack:629a0cf2-6cfa-49d7-8765-9d86ce8239c2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] deleating volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd@v_27b4700f-a1b7-4450-8b39-5270a460f507', 'is_clone': True, 'full_name': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507', 'name': 'v_27b4700f-a1b7-4450-8b39-5270a460f507'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] get volume v_27b4700f-a1b7-4450-8b39-5270a460f507 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4afdbef5-8050-47b0-bc7d-67da76a2695e', 'is_clone': False, 'name': 'v_4afdbef5-8050-47b0-bc7d-67da76a2695e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40760213-9224-413f-810f-c438ca994fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4afdbef5-8050-47b0-bc7d-67da76a2695e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f57748-99c8-4371-83f8-80e417a5f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd@v_27b4700f-a1b7-4450-8b39-5270a460f507', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432140', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107745', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6564703528217719082', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c2db698b69472704', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342502400', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '78623', 'name': 'v_27b4700f-a1b7-4450-8b39-5270a460f507', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d94bf6f7-2e85-4aa1-b84b-c700b346321a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27b4700f-a1b7-4450-8b39-5270a460f507', 'volume_size': 1, 'source_volid': 'f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'source_volstatus': 'downloading'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0917c9-357c-492d-887f-d2958cd4298f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:31 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Volume volume-4afdbef5-8050-47b0-bc7d-67da76a2695e (4afdbef5-8050-47b0-bc7d-67da76a2695e): created successfully Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f57748-99c8-4371-83f8-80e417a5f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Flow 'volume_create_manager' (5efb954e-6da6-43ed-b827-b6d5f961a2a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:31 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume volume-27b4700f-a1b7-4450-8b39-5270a460f507 (27b4700f-a1b7-4450-8b39-5270a460f507): created successfully Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b0917c9-357c-492d-887f-d2958cd4298f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (2f82ffee-0546-4561-982b-508b1c3d5fbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-33f4508d-9a73-40e5-8eff-8c314f19e6a1 tempest-VolumesListAdminTestJSON-780914272 None] Created volume successfully. Apr 14 00:05:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Created volume successfully. Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Creating new image-volume cache entry for image 6db62068-7278-4cd8-b41f-d0140d89e199 on user@joviandss-2#joviandss-2 {{(pid=84560) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] New image-volume cache entry created: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 5, 31, 471473)}. {{(pid=84560) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 25.950s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Marking volume f1a3323a-058c-4e1d-8627-04fbfb2310bd as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Creating volume glance metadata for volume f1a3323a-058c-4e1d-8627-04fbfb2310bd backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=31,cinder:SELECT=60,cinder:INSERT=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dfbe87-e5ed-49da-bd31-f8452fd22814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a3323a-058c-4e1d-8627-04fbfb2310bd', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60833594-abe0-4db3-95d2-90045a363ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:31 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Volume volume-f1a3323a-058c-4e1d-8627-04fbfb2310bd (f1a3323a-058c-4e1d-8627-04fbfb2310bd): created successfully Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60833594-abe0-4db3-95d2-90045a363ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (ea28b8b3-8d58-4ba6-a84b-d59a577cdcff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-98efc8f2-6850-43db-b164-1797b8789f2a tempest-TaggedBootDevicesTest-1396120968 None] Created volume successfully. Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] get volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432116', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107685', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12918909376710678314', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '316cfb9185f8315e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342490112', 'san:volume_id': '316cfb9185f8315e68c029070efb7d38e43255fe', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78249', 'name': 'v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] delete volume:v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:32 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (95b72d13-c00a-4f04-80f1-7c47ad96595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f887e573-67eb-4665-a69f-8409c5d1a2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f887e573-67eb-4665-a69f-8409c5d1a2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-852164644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c61b919a-21cb-438b-aa6a-9876ba06231d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:33Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c6a9de-1e2a-425c-b6e3-f3793e7e7af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18c6a9de-1e2a-425c-b6e3-f3793e7e7af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcba92f-75d3-4325-ae52-5d5b340f52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bcba92f-75d3-4325-ae52-5d5b340f52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c61b919a-21cb-438b-aa6a-9876ba06231d', 'volume_name': 'volume-c61b919a-21cb-438b-aa6a-9876ba06231d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428c5876-d10d-42be-a0f8-c3d9dfbb1a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428c5876-d10d-42be-a0f8-c3d9dfbb1a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0fdcf4-c070-44d9-8f43-0275986cb4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Volume c61b919a-21cb-438b-aa6a-9876ba06231d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c61b919a-21cb-438b-aa6a-9876ba06231d', 'volume_size': 1} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] creating volume v_c61b919a-21cb-438b-aa6a-9876ba06231d. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] create volume {'name': 'v_c61b919a-21cb-438b-aa6a-9876ba06231d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Flow 'volume_create_manager' (cc651b7d-8c39-4588-94cb-98b8922daf2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeda7829-7ae6-40c8-aa50-1cd072d4982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeda7829-7ae6-40c8-aa50-1cd072d4982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c824b720-5d13-45e5-97d3-c317485d2d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2210c9bac97f454abee21e698d424318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:34Z,use_quota=True,user_id='290bfe87716f437d9cb0c562a3b14bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0894092f-da31-47d6-96af-fd5b925656b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0894092f-da31-47d6-96af-fd5b925656b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05217378-dfd9-42c1-bd3c-d316da855de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05217378-dfd9-42c1-bd3c-d316da855de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c824b720-5d13-45e5-97d3-c317485d2d97', 'volume_name': 'volume-c824b720-5d13-45e5-97d3-c317485d2d97', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd154cd-5d6e-4b80-889d-2b42ab874aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dd154cd-5d6e-4b80-889d-2b42ab874aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8f116d-6563-4253-9205-2c97f7b39511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:33 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Volume c824b720-5d13-45e5-97d3-c317485d2d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c824b720-5d13-45e5-97d3-c317485d2d97', 'volume_size': 1} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] creating volume v_c824b720-5d13-45e5-97d3-c317485d2d97. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] create volume {'name': 'v_c824b720-5d13-45e5-97d3-c317485d2d97', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] volume v_629a0cf2-6cfa-49d7-8765-9d86ce8239c2 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c61b919a-21cb-438b-aa6a-9876ba06231d', 'is_clone': False, 'name': 'v_c61b919a-21cb-438b-aa6a-9876ba06231d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0fdcf4-c070-44d9-8f43-0275986cb4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c61b919a-21cb-438b-aa6a-9876ba06231d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfd5364-a3e1-4d88-a9f3-bf94489c4729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:34 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Volume volume-c61b919a-21cb-438b-aa6a-9876ba06231d (c61b919a-21cb-438b-aa6a-9876ba06231d): created successfully Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dfd5364-a3e1-4d88-a9f3-bf94489c4729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (95b72d13-c00a-4f04-80f1-7c47ad96595d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:34 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a034fe6a-1352-4a2c-a4b4-7d9ba24a2659 tempest-TaggedBootDevicesTest-1396120968 None] Created volume successfully. Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.quota [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['3df169c6-d1bb-4969-b131-a8cfdd4f7916'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:34 user cinder-volume[84560]: WARNING cinder.quota [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1526482602 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1526482602, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.quota [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['515042e3-ab20-46ff-8a02-93979eb350a7', 'baac7c20-56d8-49e7-a6a7-fbcdf823fd4b', '7c932e70-68a4-438a-b4c8-600b2dce05cc', '5b29d6f1-b524-4ba6-a616-18a667c9584f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:34 user cinder-volume[84560]: DEBUG cinder.quota [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['b0309f08-6358-4acb-88a9-e9906cc1ff83', '34613b43-304c-480d-9d32-984861d47c14', 'cdce7409-3949-4570-899a-3c9fa442f379', '0b680223-69d8-4860-aaea-1e95e62a7876'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=29,cinder:SELECT=52,cinder:DELETE=4,cinder:INSERT=15 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c824b720-5d13-45e5-97d3-c317485d2d97', 'is_clone': False, 'name': 'v_c824b720-5d13-45e5-97d3-c317485d2d97'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8f116d-6563-4253-9205-2c97f7b39511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c824b720-5d13-45e5-97d3-c317485d2d97', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b538884e-111d-4321-9b87-9798c86295c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:35 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Volume volume-c824b720-5d13-45e5-97d3-c317485d2d97 (c824b720-5d13-45e5-97d3-c317485d2d97): created successfully Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b538884e-111d-4321-9b87-9798c86295c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Flow 'volume_create_manager' (cc651b7d-8c39-4588-94cb-98b8922daf2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a8d4b94f-8ffa-4ae8-986a-adf2e509c7f1 tempest-VolumesListAdminTestJSON-570246095 None] Created volume successfully. Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342408192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.manager [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-bd04cd31-9f5f-4f6c-b917-2b013c01b898 tempest-GroupSnapshotsTest-1353205053 None] Delete group completed successfully. Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (df97d4b4-7134-4b20-8c73-c05fa7293f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203922f9-cb4a-4539-b316-6a2dbf942200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203922f9-cb4a-4539-b316-6a2dbf942200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-367077710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=20a8a1b6-5d63-4d2b-b3b1-a642c0690120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:36Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc1e0e-5fd6-4453-b2bb-9a49d8d8b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bc1e0e-5fd6-4453-b2bb-9a49d8d8b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec405611-9339-4ca3-8fa2-0370baed7fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec405611-9339-4ca3-8fa2-0370baed7fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'volume_name': 'volume-20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2ac17b-6c8d-4ef2-a5e3-75e85e2f5fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2ac17b-6c8d-4ef2-a5e3-75e85e2f5fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520c6006-21f3-42ea-9a59-a7975061943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:35 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Volume 20a8a1b6-5d63-4d2b-b3b1-a642c0690120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'volume_size': 1} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] creating volume v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] create volume {'name': 'v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Acquiring lock "cinder-c824b720-5d13-45e5-97d3-c317485d2d97-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Lock "cinder-c824b720-5d13-45e5-97d3-c317485d2d97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] remove_export for volume: c824b720-5d13-45e5-97d3-c317485d2d97. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c824b720-5d13-45e5-97d3-c317485d2d97,launched_at=2023-04-14T00:05:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2210c9bac97f454abee21e698d424318',provider_auth='CHAP pJwmuUhC c9ZTsGLC4H2zvA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:34Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:05:36Z,updated_at=2023-04-14T00:05:36Z,use_quota=True,user_id='290bfe87716f437d9cb0c562a3b14bc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] detach volume v_c824b720-5d13-45e5-97d3-c317485d2d97 from target iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97/luns/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97/luns/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97/luns/v_c824b720-5d13-45e5-97d3-c317485d2d97'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97/luns/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] failed to remove resource iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 because of JDSS resource v_c824b720-5d13-45e5-97d3-c317485d2d97 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] delete target: iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] delete target iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] failed to remove resource iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 because of JDSS resource iqn.2010-10.org.openstack:c824b720-5d13-45e5-97d3-c317485d2d97 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] deleating volume v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] get snapshots for volume v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Acquiring lock "cinder-4afdbef5-8050-47b0-bc7d-67da76a2695e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Lock "cinder-4afdbef5-8050-47b0-bc7d-67da76a2695e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] remove_export for volume: 4afdbef5-8050-47b0-bc7d-67da76a2695e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2060137070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4afdbef5-8050-47b0-bc7d-67da76a2695e,launched_at=2023-04-14T00:05:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3532e77f484340bab1e4512b525f1cf4',provider_auth='CHAP FqoQHuCi i2xrIkpdOe1Tvu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:30Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:05:36Z,updated_at=2023-04-14T00:05:36Z,use_quota=True,user_id='c1c752aef8934c649d496f3fd9ffec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] detach volume v_4afdbef5-8050-47b0-bc7d-67da76a2695e from target iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e/luns/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e/luns/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e/luns/v_4afdbef5-8050-47b0-bc7d-67da76a2695e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e/luns/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] failed to remove resource iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e because of JDSS resource v_4afdbef5-8050-47b0-bc7d-67da76a2695e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] delete target: iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] delete target iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] failed to remove resource iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e because of JDSS resource iqn.2010-10.org.openstack:4afdbef5-8050-47b0-bc7d-67da76a2695e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] deleating volume v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] get snapshots for volume v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-82200964-32de-4b70-9e32-231795ffa964 tempest-GroupSnapshotsTest-1353205053 None] Group tempest-GroupSnapshotsTest-Group-839628934: creating Apr 14 00:05:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:INSERT=8,cinder:SELECT=61,cinder:UPDATE=29,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-82200964-32de-4b70-9e32-231795ffa964 tempest-GroupSnapshotsTest-1353205053 None] Group tempest-GroupSnapshotsTest-Group-839628934: created successfully Apr 14 00:05:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-82200964-32de-4b70-9e32-231795ffa964 tempest-GroupSnapshotsTest-1353205053 None] Create group completed successfully. Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'is_clone': False, 'name': 'v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (520c6006-21f3-42ea-9a59-a7975061943f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43c9b3d-ae5f-42a2-a4be-fb5a41a1acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] get volume v_c824b720-5d13-45e5-97d3-c317485d2d97 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Volume volume-20a8a1b6-5d63-4d2b-b3b1-a642c0690120 (20a8a1b6-5d63-4d2b-b3b1-a642c0690120): created successfully Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43c9b3d-ae5f-42a2-a4be-fb5a41a1acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Flow 'volume_create_manager' (df97d4b4-7134-4b20-8c73-c05fa7293f58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c824b720-5d13-45e5-97d3-c317485d2d97', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432144', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107758', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '187854628698544077', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '76f5d9f437ed66de', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342313984', 'san:volume_id': '76f5d9f437ed66de653c89ab509f40d45b5f47af', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78635', 'name': 'v_c824b720-5d13-45e5-97d3-c317485d2d97', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] delete volume:v_c824b720-5d13-45e5-97d3-c317485d2d97 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0a2a3032-c653-4eef-8546-f5a281845baf tempest-TaggedBootDevicesTest-1396120968 None] Created volume successfully. Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] get volume v_4afdbef5-8050-47b0-bc7d-67da76a2695e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4afdbef5-8050-47b0-bc7d-67da76a2695e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432140', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107748', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7549630040494233194', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fbb067646278330b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342313984', 'san:volume_id': 'fbb067646278330b1bfc12acdfb0489dfd8a7e3c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78262', 'name': 'v_4afdbef5-8050-47b0-bc7d-67da76a2695e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] delete volume:v_4afdbef5-8050-47b0-bc7d-67da76a2695e recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (00a25a6c-fba4-407c-abe8-cbc81f26b4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31919c23-43e8-45f9-a930-f2e3d774cff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31919c23-43e8-45f9-a930-f2e3d774cff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029445322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=007c3437-13cc-414c-a1cd-25c94199d09e,host='user@joviandss-2#joviandss-2',id=a62dbb06-933e-4727-9931-a8f0bd6b4903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:38Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71b61326-d80d-4977-9050-692de67a283d),volume_type_id=71b61326-d80d-4977-9050-692de67a283d)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbacb5a-f3ef-4819-905b-af43284ab7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bbacb5a-f3ef-4819-905b-af43284ab7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c1ef88-b5c7-4bc9-9700-c93d9e0f0b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c1ef88-b5c7-4bc9-9700-c93d9e0f0b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a62dbb06-933e-4727-9931-a8f0bd6b4903', 'volume_name': 'volume-a62dbb06-933e-4727-9931-a8f0bd6b4903', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9e876a-ecd2-430f-aad2-3525a59d0f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9e876a-ecd2-430f-aad2-3525a59d0f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19231f79-3e7c-4e51-860f-f4b074e37f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Volume a62dbb06-933e-4727-9931-a8f0bd6b4903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a62dbb06-933e-4727-9931-a8f0bd6b4903', 'volume_size': 1} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] creating volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] create volume {'name': 'v_a62dbb06-933e-4727-9931-a8f0bd6b4903', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c824b720-5d13-45e5-97d3-c317485d2d97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] volume v_c824b720-5d13-45e5-97d3-c317485d2d97 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.quota [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Created reservations ['12156834-45f1-4279-8aeb-5885d93cb42d', '26b60e50-a0d7-427c-9e43-9f852be7fe73', 'e1632f00-5283-4eb5-a863-cf3398227e0a', '8ac21226-14f2-4ff7-a79f-e4903f748fc4'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4afdbef5-8050-47b0-bc7d-67da76a2695e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] volume v_4afdbef5-8050-47b0-bc7d-67da76a2695e deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.quota [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Created reservations ['6d399247-819a-4647-b3a4-5a11b1e8addb', 'a3cc6901-36b1-43ea-bc4c-09b620233b58', '9aa423e2-eb8a-4953-b056-c197d6204a07', 'b54c2784-e6a2-45a8-82fa-f1a8cb6e7051'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342408192', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.manager [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Deleted volume successfully. Apr 14 00:05:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d5e1be71-d00d-4370-a62e-1d0689c82294 tempest-VolumesListAdminTestJSON-780914272 None] Lock "cinder-4afdbef5-8050-47b0-bc7d-67da76a2695e-delete_volume" released by "delete_volume" :: held 2.595s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342420480', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.manager [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a62dbb06-933e-4727-9931-a8f0bd6b4903', 'is_clone': False, 'name': 'v_a62dbb06-933e-4727-9931-a8f0bd6b4903'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Deleted volume successfully. Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19231f79-3e7c-4e51-860f-f4b074e37f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a62dbb06-933e-4727-9931-a8f0bd6b4903', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aa485b-559c-4452-9972-9e379ab58614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:39 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Volume volume-a62dbb06-933e-4727-9931-a8f0bd6b4903 (a62dbb06-933e-4727-9931-a8f0bd6b4903): created successfully Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0aa485b-559c-4452-9972-9e379ab58614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Flow 'volume_create_manager' (00a25a6c-fba4-407c-abe8-cbc81f26b4b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bf55a444-69bf-49a6-98bb-9f08297a51e9 tempest-VolumesListAdminTestJSON-570246095 None] Lock "cinder-c824b720-5d13-45e5-97d3-c317485d2d97-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:05:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5891e07a-8c22-44a0-85b0-0b297ead96dd tempest-GroupSnapshotsTest-1353205053 None] Created volume successfully. Apr 14 00:05:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] GroupSnapshot de207444-bb25-40d6-9209-7637f5441694: creating. Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Acquiring lock "cinder-a7510f1f-a05d-4935-aa83-033a3dfc7fb9-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Group snapshot de207444-bb25-40d6-9209-7637f5441694: creating. {{(pid=84560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4129}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Lock "cinder-a7510f1f-a05d-4935-aa83-033a3dfc7fb9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] create snapshot b68d64ed-8b19-4abe-9793-06fc642ca19a for volume a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] cloning v_a62dbb06-933e-4727-9931-a8f0bd6b4903 to s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] create snapshot s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] remove_export for volume: a7510f1f-a05d-4935-aa83-033a3dfc7fb9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1194875063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7510f1f-a05d-4935-aa83-033a3dfc7fb9,launched_at=2023-04-14T00:05:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3532e77f484340bab1e4512b525f1cf4',provider_auth='CHAP iRKatuxc 9ekZNmAiKcuBVn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:27Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:05:40Z,updated_at=2023-04-14T00:05:40Z,use_quota=True,user_id='c1c752aef8934c649d496f3fd9ffec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] detach volume v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 from target iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9/luns/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9/luns/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9/luns/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9/luns/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] failed to remove resource iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 because of JDSS resource v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] delete target: iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] delete target iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] failed to remove resource iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 because of JDSS resource iqn.2010-10.org.openstack:a7510f1f-a05d-4935-aa83-033a3dfc7fb9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] deleating volume v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] get snapshots for volume v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] get volume v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432137', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107738', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13775749852641069698', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '55b892084712be67', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342408192', 'san:volume_id': '55b892084712be67b237eab2c42dfeadf4fb683c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '76398', 'name': 'v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] delete volume:v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_b68d64ed-8b19-4abe-9793-06fc642ca19a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] create volume s_b68d64ed-8b19-4abe-9793-06fc642ca19a from snapshot s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a62dbb06-933e-4727-9931-a8f0bd6b4903@s_b68d64ed-8b19-4abe-9793-06fc642ca19a', 'is_clone': True, 'full_name': 'Pool-0/s_b68d64ed-8b19-4abe-9793-06fc642ca19a', 'name': 's_b68d64ed-8b19-4abe-9793-06fc642ca19a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] volume s_b68d64ed-8b19-4abe-9793-06fc642ca19a properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:05:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-289bbbeb-e1fa-40ad-9e9f-8741150fc265 tempest-GroupSnapshotsTest-1353205053 None] group_snapshot de207444-bb25-40d6-9209-7637f5441694: created successfully Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] volume v_a7510f1f-a05d-4935-aa83-033a3dfc7fb9 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] group_snapshot de207444-bb25-40d6-9209-7637f5441694: deleting Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] group_snapshot de207444-bb25-40d6-9209-7637f5441694: deleting {{(pid=84560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4304}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] deleating snapshot s_b68d64ed-8b19-4abe-9793-06fc642ca19a. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.quota [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Created reservations ['3414175c-3b50-429e-9d98-94562d7affdc', '523c28a7-2226-44b3-bd63-310b26c79f03', '1be240f6-9ecb-4e39-96ce-ec0f19e5eab6', 'e804005c-349b-4030-8623-338fb23f29a6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=61,cinder:UPDATE=29,cinder:DELETE=2,cinder:INSERT=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] get volume s_b68d64ed-8b19-4abe-9793-06fc642ca19a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a62dbb06-933e-4727-9931-a8f0bd6b4903@s_b68d64ed-8b19-4abe-9793-06fc642ca19a', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_b68d64ed-8b19-4abe-9793-06fc642ca19a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432150', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107774', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16194107416622224915', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '61deb9af07c2edcf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342465536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78877', 'name': 's_b68d64ed-8b19-4abe-9793-06fc642ca19a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] delete snapshot s_b68d64ed-8b19-4abe-9793-06fc642ca19a of volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots/s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots/s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342465536', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.manager [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Deleted volume successfully. Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe63bbd8-b3ac-4b08-bb95-7a6d031b2a93 tempest-VolumesListAdminTestJSON-780914272 None] Lock "cinder-a7510f1f-a05d-4935-aa83-033a3dfc7fb9-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Acquiring lock "cinder-4e932259-c14a-4645-beb4-db5dba541f58-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Lock "cinder-4e932259-c14a-4645-beb4-db5dba541f58-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] remove_export for volume: 4e932259-c14a-4645-beb4-db5dba541f58. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-759988822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4e932259-c14a-4645-beb4-db5dba541f58,launched_at=2023-04-14T00:05:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3532e77f484340bab1e4512b525f1cf4',provider_auth='CHAP uRpNUaTx z63kNQ0TwKh52g',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:05:43Z,updated_at=2023-04-14T00:05:43Z,use_quota=True,user_id='c1c752aef8934c649d496f3fd9ffec9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] detach volume v_4e932259-c14a-4645-beb4-db5dba541f58 from target iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58/luns/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58/luns/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58/luns/v_4e932259-c14a-4645-beb4-db5dba541f58'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58/luns/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] failed to remove resource iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 because of JDSS resource v_4e932259-c14a-4645-beb4-db5dba541f58 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] delete target: iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] delete target iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] failed to remove resource iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 because of JDSS resource iqn.2010-10.org.openstack:4e932259-c14a-4645-beb4-db5dba541f58 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] deleating volume v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] get snapshots for volume v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] get volume v_4e932259-c14a-4645-beb4-db5dba541f58 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4e932259-c14a-4645-beb4-db5dba541f58', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432135', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107727', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7044317566080421145', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b9875a5b2dc19bec', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342477824', 'san:volume_id': 'b9875a5b2dc19bec1f1245bdddbe2bc8939b00f3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78502', 'name': 'v_4e932259-c14a-4645-beb4-db5dba541f58', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] delete volume:v_4e932259-c14a-4645-beb4-db5dba541f58 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots/s_b68d64ed-8b19-4abe-9793-06fc642ca19a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] snapshot s_b68d64ed-8b19-4abe-9793-06fc642ca19a deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:05:44 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=32,cinder:SELECT=61,cinder:INSERT=4,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:44 user cinder-volume[84560]: WARNING cinder.quota [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1641342661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1641342661, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:44 user cinder-volume[84560]: WARNING cinder.quota [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1641342661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1641342661, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:44 user cinder-volume[84560]: DEBUG cinder.quota [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['5f1418c9-c670-401c-ab1b-69ad04dea7f7', 'd50fdce5-5637-431a-835b-18dfef2ea7f5', 'c0a70187-e402-4954-a826-dcd37b4d90ff', '56080ee9-4af9-43a8-85c9-086f47daec61'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:44 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d6b4f40c-1269-4aa5-9eed-c879fcfe5f3c tempest-GroupSnapshotsTest-1353205053 None] group_snapshot de207444-bb25-40d6-9209-7637f5441694: deleted successfully Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4e932259-c14a-4645-beb4-db5dba541f58 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] volume v_4e932259-c14a-4645-beb4-db5dba541f58 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] remove_export for volume: a62dbb06-933e-4727-9931-a8f0bd6b4903. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2029445322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=007c3437-13cc-414c-a1cd-25c94199d09e,host='user@joviandss-2#joviandss-2',id=a62dbb06-933e-4727-9931-a8f0bd6b4903,launched_at=2023-04-14T00:05:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5cb49fad79f4c72a0b8b651b3849f7d',provider_auth='CHAP UjyGihDC Tj4uUfPmZseNlt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:38Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:05:46Z,use_quota=True,user_id='a1765b91ebb04c79b00acb0143ee3240',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71b61326-d80d-4977-9050-692de67a283d),volume_type_id=71b61326-d80d-4977-9050-692de67a283d) from target:iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] detach volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903 from target iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903/luns/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903/luns/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903/luns/v_a62dbb06-933e-4727-9931-a8f0bd6b4903'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903/luns/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 because of JDSS resource v_a62dbb06-933e-4727-9931-a8f0bd6b4903 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] delete target: iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] delete target iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:45 user cinder-volume[84560]: DEBUG cinder.quota [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Created reservations ['79224701-7a47-40f5-8791-d78d3aa92ff6', '1b8a5c18-742c-4932-8643-5ef3e44592d5', '99137cf9-28d8-477a-920a-f1c152ea9118', '0da2b948-21e3-481a-abad-03733aaea875'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] failed to remove resource iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 because of JDSS resource iqn.2010-10.org.openstack:a62dbb06-933e-4727-9931-a8f0bd6b4903 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] deleating volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] get snapshots for volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] get volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a62dbb06-933e-4727-9931-a8f0bd6b4903', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432148', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107768', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5297153628573367758', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3ebcf30cbb2cfc9e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342559744', 'san:volume_id': '3ebcf30cbb2cfc9e89e0200b8f0bc2ac8fd15238', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78108', 'name': 'v_a62dbb06-933e-4727-9931-a8f0bd6b4903', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] delete volume:v_a62dbb06-933e-4727-9931-a8f0bd6b4903 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342559744', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.manager [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:46 user cinder-volume[84560]: INFO cinder.volume.manager [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Deleted volume successfully. Apr 14 00:05:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-def16666-fa8c-4860-8d52-60fb6eb45a8a tempest-VolumesListAdminTestJSON-780914272 None] Lock "cinder-4e932259-c14a-4645-beb4-db5dba541f58-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a62dbb06-933e-4727-9931-a8f0bd6b4903 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] volume v_a62dbb06-933e-4727-9931-a8f0bd6b4903 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.quota [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['4e1bf70b-2523-40db-9fe0-a2c108998d33'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:48 user cinder-volume[84560]: WARNING cinder.quota [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1641342661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1641342661, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.quota [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Created reservations ['0fcf68ef-f413-437b-9577-7e0f284af77e', '65277ee6-2260-48cc-8188-538d841e584e', 'b9d2e22d-4045-459f-acaa-05d3f37719f3', '3fd1c9d2-edf4-4e8d-bf00-139f69536fe4'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342641664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:49 user cinder-volume[84560]: DEBUG cinder.manager [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e3afe3a8-ca69-41df-a736-f34948b5c123 tempest-GroupSnapshotsTest-1353205053 None] Delete group completed successfully. Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Flow 'volume_create_manager' (4614018d-6b48-483a-837a-e8f8aa1365a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7552fe56-5bb8-4101-bc37-60571425bff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7552fe56-5bb8-4101-bc37-60571425bff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1280185734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=747dd5b8-16f0-41c4-99a2-9345762cc9ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44d9c133441466683c2cf683daa1482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:51Z,use_quota=True,user_id='72561dc046ae48a4a27ecd64a720f26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a745a0-ee1f-4cfe-a33c-ce6946037d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6a745a0-ee1f-4cfe-a33c-ce6946037d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58e7221-4c7d-4c71-8797-0032cce88049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e58e7221-4c7d-4c71-8797-0032cce88049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'volume_name': 'volume-747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24731e63-1952-4d68-88f6-2e0f5d23be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24731e63-1952-4d68-88f6-2e0f5d23be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc3863e-87e0-4849-9ee4-bade88b56a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Volume 747dd5b8-16f0-41c4-99a2-9345762cc9ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'volume_size': 1} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] creating volume v_747dd5b8-16f0-41c4-99a2-9345762cc9ce. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] create volume {'name': 'v_747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'is_clone': False, 'name': 'v_747dd5b8-16f0-41c4-99a2-9345762cc9ce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc3863e-87e0-4849-9ee4-bade88b56a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6407543d-3d3d-4d6a-bb21-08e416097514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Volume volume-747dd5b8-16f0-41c4-99a2-9345762cc9ce (747dd5b8-16f0-41c4-99a2-9345762cc9ce): created successfully Apr 14 00:05:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6407543d-3d3d-4d6a-bb21-08e416097514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Flow 'volume_create_manager' (4614018d-6b48-483a-837a-e8f8aa1365a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f5564a76-a766-4556-b318-85bcebfd7fbd tempest-VolumesTransfersV355Test-1766269124 None] Created volume successfully. Apr 14 00:05:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-aec50b17-d43b-4bbf-91a7-5f4a333187c4 tempest-VolumesTransfersV355Test-860570040 None] Transfer volume completed successfully. Apr 14 00:05:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b3068e6c-5788-403f-9039-f82ba9e4fa82 tempest-GroupsV320Test-861645583 None] Group tempest-GroupsV320Test-Group-1754144461: creating Apr 14 00:05:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b3068e6c-5788-403f-9039-f82ba9e4fa82 tempest-GroupsV320Test-861645583 None] Group tempest-GroupsV320Test-Group-1754144461: created successfully Apr 14 00:05:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b3068e6c-5788-403f-9039-f82ba9e4fa82 tempest-GroupsV320Test-861645583 None] Create group completed successfully. Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Acquiring lock "cinder-747dd5b8-16f0-41c4-99a2-9345762cc9ce-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Lock "cinder-747dd5b8-16f0-41c4-99a2-9345762cc9ce-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] remove_export for volume: 747dd5b8-16f0-41c4-99a2-9345762cc9ce. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1280185734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=747dd5b8-16f0-41c4-99a2-9345762cc9ce,launched_at=2023-04-14T00:05:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91839c9e22364e6aa8e80869d6f6ad58',provider_auth='CHAP JqlcjyQt J5dLMuYsNi4ZRF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:05:54Z,updated_at=2023-04-14T00:05:54Z,use_quota=True,user_id='3d2c7b9235a34b068df1c0b7886562c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] detach volume v_747dd5b8-16f0-41c4-99a2-9345762cc9ce from target iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce/luns/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce/luns/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce/luns/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce/luns/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] failed to remove resource iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce because of JDSS resource v_747dd5b8-16f0-41c4-99a2-9345762cc9ce DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] delete target: iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] delete target iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] failed to remove resource iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce because of JDSS resource iqn.2010-10.org.openstack:747dd5b8-16f0-41c4-99a2-9345762cc9ce DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] deleating volume v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] get snapshots for volume v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] get volume v_747dd5b8-16f0-41c4-99a2-9345762cc9ce info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432161', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107785', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5097813485293712258', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b1e4029eccab7799', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342535168', 'san:volume_id': 'b1e4029eccab7799f8c68058efb5d6f944f1dac7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78987', 'name': 'v_747dd5b8-16f0-41c4-99a2-9345762cc9ce', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] delete volume:v_747dd5b8-16f0-41c4-99a2-9345762cc9ce recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.quota [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Created reservations ['97fe086d-5615-45a3-bad5-5a98c0ea943b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_747dd5b8-16f0-41c4-99a2-9345762cc9ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] volume v_747dd5b8-16f0-41c4-99a2-9345762cc9ce deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:INSERT=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.quota [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Created reservations ['2eb794dd-e7aa-4671-871d-7575edf2047b', '5cfb835c-544c-4765-90ff-0783f8e433ef', '3de475aa-f31a-407a-aa57-31719b5bc34e', 'bf689251-2a2a-4c67-a26b-8dac1e0589f6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342617088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:56 user cinder-volume[84560]: DEBUG cinder.manager [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:56 user cinder-volume[84560]: INFO cinder.volume.manager [None req-07508822-6e73-4c0e-b757-6451ffb6cedf tempest-GroupsV320Test-861645583 None] Delete group completed successfully. Apr 14 00:05:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342617088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:05:56 user cinder-volume[84560]: DEBUG cinder.manager [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:05:56 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Deleted volume successfully. Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b8ba39e7-6092-42cc-92fd-72b496583b40 tempest-VolumesTransfersV355Test-235107251 None] Lock "cinder-747dd5b8-16f0-41c4-99a2-9345762cc9ce-delete_volume" released by "delete_volume" :: held 3.421s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Flow 'volume_create_manager' (d49389fe-5ee9-4eb1-84f6-45a6c51a7148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1d8e87-182e-4347-a539-5b3a32df9841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1d8e87-182e-4347-a539-5b3a32df9841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-891769906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d0870b30-ceaf-41d7-9ffc-33aff4ac92b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44d9c133441466683c2cf683daa1482',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:05:57Z,use_quota=True,user_id='72561dc046ae48a4a27ecd64a720f26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39842e-61f3-4b88-bb98-96dc8fb8590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc39842e-61f3-4b88-bb98-96dc8fb8590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5de23f-a78b-46a9-8e8a-718d78dd13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c5de23f-a78b-46a9-8e8a-718d78dd13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'volume_name': 'volume-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c10be3-e2ad-49af-a38c-056a31470dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c10be3-e2ad-49af-a38c-056a31470dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e1c5f5-f235-4bfa-af07-31ba8e8a16d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:57 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Volume d0870b30-ceaf-41d7-9ffc-33aff4ac92b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'volume_size': 1} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] creating volume v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] create volume {'name': 'v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'is_clone': False, 'name': 'v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e1c5f5-f235-4bfa-af07-31ba8e8a16d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d1c1ca-980f-4a17-bb29-51081a00df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:05:58 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Volume volume-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 (d0870b30-ceaf-41d7-9ffc-33aff4ac92b6): created successfully Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66d1c1ca-980f-4a17-bb29-51081a00df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Flow 'volume_create_manager' (d49389fe-5ee9-4eb1-84f6-45a6c51a7148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:05:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-47bf85fb-8600-4741-9544-e6d3233dd3cf tempest-VolumesTransfersV355Test-1766269124 None] Created volume successfully. Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Acquiring lock "cinder-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Lock "cinder-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] remove_export for volume: d0870b30-ceaf-41d7-9ffc-33aff4ac92b6. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-891769906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d0870b30-ceaf-41d7-9ffc-33aff4ac92b6,launched_at=2023-04-14T00:05:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44d9c133441466683c2cf683daa1482',provider_auth='CHAP lhQoxHbY MBLaGXeI08VSFD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:57Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:05:59Z,updated_at=2023-04-14T00:05:59Z,use_quota=True,user_id='72561dc046ae48a4a27ecd64a720f26a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] detach volume v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 from target iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/luns/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/luns/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/luns/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/luns/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] failed to remove resource iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 because of JDSS resource v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] delete target: iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] delete target iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] failed to remove resource iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 because of JDSS resource iqn.2010-10.org.openstack:d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] deleating volume v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] get snapshots for volume v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] get volume v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432167', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107790', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7832405663956936439', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eb789b159dc7683f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342535168', 'san:volume_id': 'eb789b159dc7683f4fc85fed21c945e8da15a944', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78893', 'name': 'v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] delete volume:v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:05:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Flow 'volume_create_manager' (ed718f45-cb28-4d30-9c10-73bb65bc7f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6333a493-4946-4122-8470-ec37b4a421a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6333a493-4946-4122-8470-ec37b4a421a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-773061150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1bb56a19-30db-4ddb-bf8c-6759d0520e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a049f3029204239a25eb781fff4eb9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:00Z,use_quota=True,user_id='82d3a253f3754e7a9723d2da8c7c61cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa6dee96-34db-4e08-afba-9d80a3081902),volume_type_id=fa6dee96-34db-4e08-afba-9d80a3081902)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f6f735-fbfa-40e0-8690-d391e80c5570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f6f735-fbfa-40e0-8690-d391e80c5570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d209b-ded1-4462-a83e-136b6015a1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d209b-ded1-4462-a83e-136b6015a1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'volume_name': 'volume-1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f7434c-fcaa-4b0b-8793-296c6b5dc3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f7434c-fcaa-4b0b-8793-296c6b5dc3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b21203-1fa9-4c94-9b40-2e7813b7c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:00 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Volume 1bb56a19-30db-4ddb-bf8c-6759d0520e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'volume_size': 1} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] creating volume v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] create volume {'name': 'v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] volume v_d0870b30-ceaf-41d7-9ffc-33aff4ac92b6 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Created reservations ['a5e8bb56-4774-4767-bbeb-b1845c7351d4', 'd13194a5-bd1b-4fb8-949a-06bed6fbff1e', 'caac5ebc-fd73-4b2a-ad28-a87804e8e1f2', 'd8aed035-7637-49b8-9058-4ba9d1f55603'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'is_clone': False, 'name': 'v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b21203-1fa9-4c94-9b40-2e7813b7c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1318c07d-efec-4894-a86f-8c8ae228c358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:01 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Volume volume-1bb56a19-30db-4ddb-bf8c-6759d0520e2a (1bb56a19-30db-4ddb-bf8c-6759d0520e2a): created successfully Apr 14 00:06:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1318c07d-efec-4894-a86f-8c8ae228c358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Flow 'volume_create_manager' (ed718f45-cb28-4d30-9c10-73bb65bc7f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8bbe60ab-9bac-40db-8748-c84f34f83ab6 tempest-VolumeTypesAccessTest-416823697 None] Created volume successfully. Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342535168', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.manager [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Deleted volume successfully. Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ffd5d274-6546-4c5b-9f5e-03896932f993 tempest-VolumesTransfersV355Test-235107251 None] Lock "cinder-d0870b30-ceaf-41d7-9ffc-33aff4ac92b6-delete_volume" released by "delete_volume" :: held 3.711s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Acquiring lock "cinder-1bb56a19-30db-4ddb-bf8c-6759d0520e2a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Lock "cinder-1bb56a19-30db-4ddb-bf8c-6759d0520e2a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] remove_export for volume: 1bb56a19-30db-4ddb-bf8c-6759d0520e2a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-773061150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1bb56a19-30db-4ddb-bf8c-6759d0520e2a,launched_at=2023-04-14T00:06:02Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a049f3029204239a25eb781fff4eb9a',provider_auth='CHAP ESUpkWfn TpH5XKW7LPjsAf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:00Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:03Z,updated_at=2023-04-14T00:06:03Z,use_quota=True,user_id='82d3a253f3754e7a9723d2da8c7c61cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa6dee96-34db-4e08-afba-9d80a3081902),volume_type_id=fa6dee96-34db-4e08-afba-9d80a3081902) from target:iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] detach volume v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a from target iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a/luns/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a/luns/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a/luns/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a/luns/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] failed to remove resource iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a because of JDSS resource v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] delete target: iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] delete target iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] failed to remove resource iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a because of JDSS resource iqn.2010-10.org.openstack:1bb56a19-30db-4ddb-bf8c-6759d0520e2a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] deleating volume v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] get snapshots for volume v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] get volume v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432171', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107795', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13478721718591071402', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '24af993388e17ca1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342535168', 'san:volume_id': '24af993388e17ca1974a0a58a913b15817fc902a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78904', 'name': 'v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] delete volume:v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] volume v_1bb56a19-30db-4ddb-bf8c-6759d0520e2a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:04 user cinder-volume[84560]: WARNING cinder.quota [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-484844173 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-484844173, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:06:04 user cinder-volume[84560]: WARNING cinder.quota [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-484844173 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-484844173, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.quota [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Created reservations ['7ee3f463-440f-4ec5-b020-c79627b2198d', '32f3e425-19a4-436e-a6e0-0943da84d6af', 'd505de61-8fbf-4f9e-a7f1-304f083d6cd7', 'ddbc6758-323f-4ce6-84b4-41f4ca16b102'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342617088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:05 user cinder-volume[84560]: DEBUG cinder.manager [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:05 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Deleted volume successfully. Apr 14 00:06:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d1d2230a-6091-4531-a68f-138e78386629 tempest-VolumeTypesAccessTest-416823697 None] Lock "cinder-1bb56a19-30db-4ddb-bf8c-6759d0520e2a-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:10 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Flow 'volume_create_manager' (fbc3cd62-4632-41c7-ae62-35a97874ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854bb3e7-8f36-42b1-a506-47142b370e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (854bb3e7-8f36-42b1-a506-47142b370e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-646133030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9d48a603-9112-4474-8546-7358c678b6b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc0b7ab3c9c4f05b2bd8772adc40911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:11Z,use_quota=True,user_id='2bf88980fc284b0e92f45c6458b62a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca169c9-4a01-4ffb-a1ca-02b308423fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca169c9-4a01-4ffb-a1ca-02b308423fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34ef9d8-2dd3-43d8-8820-edb5ca7fcfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34ef9d8-2dd3-43d8-8820-edb5ca7fcfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d48a603-9112-4474-8546-7358c678b6b7', 'volume_name': 'volume-9d48a603-9112-4474-8546-7358c678b6b7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1139cd94-c1b2-4c16-a5b3-80ebf8bf613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1139cd94-c1b2-4c16-a5b3-80ebf8bf613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5344e03-fa5b-4917-8915-2a8ff9f4bb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:11 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Volume 9d48a603-9112-4474-8546-7358c678b6b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d48a603-9112-4474-8546-7358c678b6b7', 'volume_size': 1} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] creating volume v_9d48a603-9112-4474-8546-7358c678b6b7. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] create volume {'name': 'v_9d48a603-9112-4474-8546-7358c678b6b7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9d48a603-9112-4474-8546-7358c678b6b7', 'is_clone': False, 'name': 'v_9d48a603-9112-4474-8546-7358c678b6b7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5344e03-fa5b-4917-8915-2a8ff9f4bb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d48a603-9112-4474-8546-7358c678b6b7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07faef8-fa07-42ec-98a5-b80cf53e8abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:11 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Volume volume-9d48a603-9112-4474-8546-7358c678b6b7 (9d48a603-9112-4474-8546-7358c678b6b7): created successfully Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f07faef8-fa07-42ec-98a5-b80cf53e8abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Flow 'volume_create_manager' (fbc3cd62-4632-41c7-ae62-35a97874ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:11 user cinder-volume[84560]: INFO cinder.volume.manager [None req-91b6aacb-2321-4f78-b64c-82b87ede96f4 tempest-VolumesTransfersV357Test-1098169695 None] Created volume successfully. Apr 14 00:06:12 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a347f0b9-4d4b-4450-9156-bff0f637d597 tempest-VolumesTransfersV357Test-1594695501 None] Transfer volume completed successfully. Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.coordination [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Acquiring lock "cinder-9d48a603-9112-4474-8546-7358c678b6b7-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.coordination [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Lock "cinder-9d48a603-9112-4474-8546-7358c678b6b7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=57,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] remove_export for volume: 9d48a603-9112-4474-8546-7358c678b6b7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-646133030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9d48a603-9112-4474-8546-7358c678b6b7,launched_at=2023-04-14T00:06:12Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7415d3ff1d5e46d6b9db07298f0b5e14',provider_auth='CHAP uxXbKPME 95UTs6tlwoGeyK',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:11Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:13Z,updated_at=2023-04-14T00:06:13Z,use_quota=True,user_id='a73a4e41880a449fb1712103eb5820cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] detach volume v_9d48a603-9112-4474-8546-7358c678b6b7 from target iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7/luns/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7/luns/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7/luns/v_9d48a603-9112-4474-8546-7358c678b6b7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7/luns/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] failed to remove resource iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 because of JDSS resource v_9d48a603-9112-4474-8546-7358c678b6b7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] delete target: iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] delete target iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] failed to remove resource iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 because of JDSS resource iqn.2010-10.org.openstack:9d48a603-9112-4474-8546-7358c678b6b7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] deleating volume v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] get snapshots for volume v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] get volume v_9d48a603-9112-4474-8546-7358c678b6b7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9d48a603-9112-4474-8546-7358c678b6b7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432181', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107801', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12364493739079920945', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '53050827634c374b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342535168', 'san:volume_id': '53050827634c374bb2796b495988fadfcd833829', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78916', 'name': 'v_9d48a603-9112-4474-8546-7358c678b6b7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] delete volume:v_9d48a603-9112-4474-8546-7358c678b6b7 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d48a603-9112-4474-8546-7358c678b6b7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] volume v_9d48a603-9112-4474-8546-7358c678b6b7 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.quota [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Created reservations ['ae11eb8b-e581-4400-8af0-e00e8f1dffcf', '008a401d-cf64-487f-a8e4-ecd32afe8b0e', '4f218783-e31b-49d2-b95b-c0f79d618888', 'a93d7124-c425-44ef-866f-3463f951daf4'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342617088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.manager [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Deleted volume successfully. Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-af2b6b15-55e2-4d13-8568-d928838baf66 tempest-VolumesTransfersV357Test-1554197435 None] Lock "cinder-9d48a603-9112-4474-8546-7358c678b6b7-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=42,cinder:SELECT=52,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Flow 'volume_create_manager' (e14dc366-6375-478d-b5e8-5ee28844533b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d15bf4f-ae45-461d-8278-92567295cd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d15bf4f-ae45-461d-8278-92567295cd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-251368095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6bc09c97-d8a1-46d1-bcdc-de20443f20ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc0b7ab3c9c4f05b2bd8772adc40911',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:17Z,use_quota=True,user_id='2bf88980fc284b0e92f45c6458b62a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003f171-d545-4bf0-a872-a70ef64a2111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5003f171-d545-4bf0-a872-a70ef64a2111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e54e1b-273e-4ea0-9e4d-507182983058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e54e1b-273e-4ea0-9e4d-507182983058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'volume_name': 'volume-6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8ad7a8-3233-4bae-9252-16cd3214a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de8ad7a8-3233-4bae-9252-16cd3214a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccb4a2c-5bf2-4dbc-973b-4eacca1f6009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Volume 6bc09c97-d8a1-46d1-bcdc-de20443f20ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'volume_size': 1} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] creating volume v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] create volume {'name': 'v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'is_clone': False, 'name': 'v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccb4a2c-5bf2-4dbc-973b-4eacca1f6009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abce8af-ded1-41cf-84c3-30c13dab8a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:17 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Volume volume-6bc09c97-d8a1-46d1-bcdc-de20443f20ac (6bc09c97-d8a1-46d1-bcdc-de20443f20ac): created successfully Apr 14 00:06:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abce8af-ded1-41cf-84c3-30c13dab8a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Flow 'volume_create_manager' (e14dc366-6375-478d-b5e8-5ee28844533b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:17 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f06728c2-be7a-485f-85dc-00657d74d671 tempest-VolumesTransfersV357Test-1098169695 None] Created volume successfully. Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Acquiring lock "cinder-6bc09c97-d8a1-46d1-bcdc-de20443f20ac-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Lock "cinder-6bc09c97-d8a1-46d1-bcdc-de20443f20ac-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] remove_export for volume: 6bc09c97-d8a1-46d1-bcdc-de20443f20ac. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-251368095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6bc09c97-d8a1-46d1-bcdc-de20443f20ac,launched_at=2023-04-14T00:06:18Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcc0b7ab3c9c4f05b2bd8772adc40911',provider_auth='CHAP gAqKUaFm UczWrOPYjnxKZi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:17Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:19Z,updated_at=2023-04-14T00:06:19Z,use_quota=True,user_id='2bf88980fc284b0e92f45c6458b62a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] detach volume v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac from target iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac/luns/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac/luns/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac/luns/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac/luns/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] failed to remove resource iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac because of JDSS resource v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] delete target: iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] delete target iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] failed to remove resource iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac because of JDSS resource iqn.2010-10.org.openstack:6bc09c97-d8a1-46d1-bcdc-de20443f20ac DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] deleating volume v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] get snapshots for volume v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] get volume v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432186', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107806', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9256727663856880824', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '46ab41baa091a966', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342535168', 'san:volume_id': '46ab41baa091a96631924638290a9c5af902aa54', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78997', 'name': 'v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] delete volume:v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Flow 'volume_create_manager' (d109bfa3-4328-416f-91ea-7d3822795db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe04635b-3f90-457b-91ec-a790ba08097e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe04635b-3f90-457b-91ec-a790ba08097e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-498124488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e63ed78-ec07-4e8f-8ec4-e81494a415a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f138770c7b4407d83c449500fc000a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:20Z,use_quota=True,user_id='6fe75acb64a94a2a88d370f43fa6b776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c697fdc7-6a71-4537-a717-7e27848f141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c697fdc7-6a71-4537-a717-7e27848f141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b80f711-61fd-4fe9-9007-50138ef49756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b80f711-61fd-4fe9-9007-50138ef49756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'volume_name': 'volume-8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20d87a8-0aa6-445c-b1b2-6b7d109757f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20d87a8-0aa6-445c-b1b2-6b7d109757f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491a4e5f-5b99-42cf-9dfb-de13f3376136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:20 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'volume_size': 1} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] creating volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] create volume {'name': 'v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] volume v_6bc09c97-d8a1-46d1-bcdc-de20443f20ac deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.quota [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Created reservations ['02a38e87-e3f7-4d38-8c69-9a92a66f424a', 'a0783827-ffea-4027-8e5d-aaf9bc4ac017', 'e2d01c12-0531-488d-acae-ad7ce5567750', '4f660160-85b4-46e2-98ab-4845eb6eceab'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'is_clone': False, 'name': 'v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491a4e5f-5b99-42cf-9dfb-de13f3376136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae524c3-b3e6-49ea-a51e-f80c24bcd711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342617088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Deleted volume successfully. Apr 14 00:06:21 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Volume volume-8e63ed78-ec07-4e8f-8ec4-e81494a415a3 (8e63ed78-ec07-4e8f-8ec4-e81494a415a3): created successfully Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae524c3-b3e6-49ea-a51e-f80c24bcd711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Flow 'volume_create_manager' (d109bfa3-4328-416f-91ea-7d3822795db5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-18f384f9-b832-4301-901c-6c35bed079cf tempest-TestStampPattern-1381824337 None] Created volume successfully. Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0044a96d-a000-4bc9-a258-49f48d1622fe tempest-VolumesTransfersV357Test-1554197435 None] Lock "cinder-6bc09c97-d8a1-46d1-bcdc-de20443f20ac-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114342510592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (918f7882-570b-490c-b6b7-3a52219021c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3817b839-4351-4bd0-8253-18dfbc9114fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3817b839-4351-4bd0-8253-18dfbc9114fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-503238230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e17fed6f-1301-437a-8346-5af70af0cdb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:26Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d689cd4-cdd8-4e3e-908b-2d0e43f50dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d689cd4-cdd8-4e3e-908b-2d0e43f50dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3bafe7-38dd-4262-95b7-8b5512506b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3bafe7-38dd-4262-95b7-8b5512506b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e17fed6f-1301-437a-8346-5af70af0cdb6', 'volume_name': 'volume-e17fed6f-1301-437a-8346-5af70af0cdb6', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d689512-c765-4fc5-989c-e77137afecf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d689512-c765-4fc5-989c-e77137afecf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dd8160-ae35-4ef5-934c-0b1e64e3aa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Volume e17fed6f-1301-437a-8346-5af70af0cdb6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e17fed6f-1301-437a-8346-5af70af0cdb6', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Cloning e17fed6f-1301-437a-8346-5af70af0cdb6 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 6, 25, 750410)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 6, 25, 765382)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] create snapshot v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e17fed6f-1301-437a-8346-5af70af0cdb6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] create volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 from snapshot v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:06:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'is_clone': True, 'full_name': 'Pool-0/v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'name': 'v_e17fed6f-1301-437a-8346-5af70af0cdb6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] get volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432196', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107817', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11925432347673495831', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e8bc83382ef70879', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342486016', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79005', 'name': 'v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Marking volume e17fed6f-1301-437a-8346-5af70af0cdb6 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to e17fed6f-1301-437a-8346-5af70af0cdb6. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Creating volume glance metadata for volume e17fed6f-1301-437a-8346-5af70af0cdb6 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5dd8160-ae35-4ef5-934c-0b1e64e3aa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17fed6f-1301-437a-8346-5af70af0cdb6', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5498fba5-770e-46d5-9d29-af35f88e6781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:27 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Volume volume-e17fed6f-1301-437a-8346-5af70af0cdb6 (e17fed6f-1301-437a-8346-5af70af0cdb6): created successfully Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5498fba5-770e-46d5-9d29-af35f88e6781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (918f7882-570b-490c-b6b7-3a52219021c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-344869a9-829d-4f16-9492-87f8e7fc6287 tempest-VolumesCloneTest-662478684 None] Created volume successfully. Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (a281c376-60b6-4b36-b8bb-3b9372ffe007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728f57a0-1dc6-40f2-b1f2-7966437809eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728f57a0-1dc6-40f2-b1f2-7966437809eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1676435110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1548d009-c579-4b26-be6a-2b2b6658ffae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e17fed6f-1301-437a-8346-5af70af0cdb6,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:28Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058eca9f-1ef3-4b8a-a6a8-3e0452ad004f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058eca9f-1ef3-4b8a-a6a8-3e0452ad004f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6881508a-9095-451f-bbf9-729c47ad9058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6881508a-9095-451f-bbf9-729c47ad9058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1548d009-c579-4b26-be6a-2b2b6658ffae', 'volume_name': 'volume-1548d009-c579-4b26-be6a-2b2b6658ffae', 'volume_size': 1, 'source_volid': 'e17fed6f-1301-437a-8346-5af70af0cdb6', 'source_volstatus': 'available'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcc2940-cc55-4b12-bbc4-7892c02929e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fcc2940-cc55-4b12-bbc4-7892c02929e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81980963-dcb0-4256-8555-9e5314dd15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Volume 1548d009-c579-4b26-be6a-2b2b6658ffae: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1548d009-c579-4b26-be6a-2b2b6658ffae', 'volume_size': 1, 'source_volid': 'e17fed6f-1301-437a-8346-5af70af0cdb6', 'source_volstatus': 'available'} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] cloned volume e17fed6f-1301-437a-8346-5af70af0cdb6 to 1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] cloning v_e17fed6f-1301-437a-8346-5af70af0cdb6 to v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] create snapshot v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_1548d009-c579-4b26-be6a-2b2b6658ffae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] create volume v_1548d009-c579-4b26-be6a-2b2b6658ffae from snapshot v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e17fed6f-1301-437a-8346-5af70af0cdb6@v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'is_clone': True, 'full_name': 'Pool-0/v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'name': 'v_1548d009-c579-4b26-be6a-2b2b6658ffae'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] get volume v_1548d009-c579-4b26-be6a-2b2b6658ffae info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e17fed6f-1301-437a-8346-5af70af0cdb6@v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432199', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107823', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6724307560649036648', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '52db8d553b5c21a9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342473728', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79020', 'name': 'v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Marking volume 1548d009-c579-4b26-be6a-2b2b6658ffae as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Copying metadata from source volume e17fed6f-1301-437a-8346-5af70af0cdb6 to 1548d009-c579-4b26-be6a-2b2b6658ffae. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:440}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81980963-dcb0-4256-8555-9e5314dd15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1548d009-c579-4b26-be6a-2b2b6658ffae', 'volume_size': 1, 'source_volid': 'e17fed6f-1301-437a-8346-5af70af0cdb6', 'source_volstatus': 'available'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6926b6-3e56-4052-9fbb-f2b7fe55c644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:30 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Volume volume-1548d009-c579-4b26-be6a-2b2b6658ffae (1548d009-c579-4b26-be6a-2b2b6658ffae): created successfully Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc6926b6-3e56-4052-9fbb-f2b7fe55c644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (a281c376-60b6-4b36-b8bb-3b9372ffe007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=56,cinder:UPDATE=28,cinder:INSERT=14,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-17d30add-3629-4238-9d1d-12b390367697 tempest-VolumesCloneTest-662478684 None] Created volume successfully. Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Acquiring lock "cinder-1548d009-c579-4b26-be6a-2b2b6658ffae-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Lock "cinder-1548d009-c579-4b26-be6a-2b2b6658ffae-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] remove_export for volume: 1548d009-c579-4b26-be6a-2b2b6658ffae. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1676435110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1548d009-c579-4b26-be6a-2b2b6658ffae,launched_at=2023-04-14T00:06:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth='CHAP TMXFJUby ymPbXHh8NGiMwd',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:28Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e17fed6f-1301-437a-8346-5af70af0cdb6,status='deleting',terminated_at=2023-04-14T00:06:30Z,updated_at=2023-04-14T00:06:30Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] detach volume v_1548d009-c579-4b26-be6a-2b2b6658ffae from target iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae/luns/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae/luns/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae/luns/v_1548d009-c579-4b26-be6a-2b2b6658ffae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae/luns/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae because of JDSS resource v_1548d009-c579-4b26-be6a-2b2b6658ffae DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] delete target: iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] delete target iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae because of JDSS resource iqn.2010-10.org.openstack:1548d009-c579-4b26-be6a-2b2b6658ffae DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] deleating volume v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] get snapshots for volume v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] get volume v_1548d009-c579-4b26-be6a-2b2b6658ffae info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e17fed6f-1301-437a-8346-5af70af0cdb6@v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432199', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107823', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6724307560649036648', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '52db8d553b5c21a9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342473728', 'san:volume_id': '52db8d553b5c21a97ac11fa4f81e5839a784c6b8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79020', 'name': 'v_1548d009-c579-4b26-be6a-2b2b6658ffae', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] delete snapshot v_1548d009-c579-4b26-be6a-2b2b6658ffae of volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots/v_1548d009-c579-4b26-be6a-2b2b6658ffae {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] snapshot v_1548d009-c579-4b26-be6a-2b2b6658ffae deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.quota [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Created reservations ['18d07807-823a-4ec2-868a-2c47388b9ded', 'f092fd86-b44f-4079-97cb-5f99722a634b', '7c655c1d-2c82-4439-9a9c-50571d3f8323', '7b99f39d-62d0-41af-a0c5-7aa5cdac080e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=22,cinder:SELECT=57,cinder:INSERT=18,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342498304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.manager [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:33 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Deleted volume successfully. Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ad16eb00-f551-46a0-9677-7163705871bc tempest-VolumesCloneTest-662478684 None] Lock "cinder-1548d009-c579-4b26-be6a-2b2b6658ffae-delete_volume" released by "delete_volume" :: held 3.202s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Acquiring lock "cinder-e17fed6f-1301-437a-8346-5af70af0cdb6-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Lock "cinder-e17fed6f-1301-437a-8346-5af70af0cdb6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] remove_export for volume: e17fed6f-1301-437a-8346-5af70af0cdb6. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-503238230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e17fed6f-1301-437a-8346-5af70af0cdb6,launched_at=2023-04-14T00:06:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth='CHAP tWHaUlQF mLu5ctKxjzfNRU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:34Z,updated_at=2023-04-14T00:06:34Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] detach volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 from target iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6/luns/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6/luns/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6/luns/v_e17fed6f-1301-437a-8346-5af70af0cdb6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6/luns/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 because of JDSS resource v_e17fed6f-1301-437a-8346-5af70af0cdb6 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] delete target: iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] delete target iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 because of JDSS resource iqn.2010-10.org.openstack:e17fed6f-1301-437a-8346-5af70af0cdb6 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] deleating volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] get snapshots for volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] get volume v_e17fed6f-1301-437a-8346-5af70af0cdb6 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432196', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107817', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11925432347673495831', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e8bc83382ef70879', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342498304', 'san:volume_id': 'e8bc83382ef70879711ae1a54185e68a8acb4885', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79005', 'name': 'v_e17fed6f-1301-437a-8346-5af70af0cdb6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] delete snapshot v_e17fed6f-1301-437a-8346-5af70af0cdb6 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_e17fed6f-1301-437a-8346-5af70af0cdb6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] snapshot v_e17fed6f-1301-437a-8346-5af70af0cdb6 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:06:35 user cinder-volume[84560]: DEBUG cinder.quota [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Created reservations ['7406975e-14f1-49c1-bc86-7cf0abff266a', 'd5e05f60-4c8a-490d-a2c2-04d6716d370c', '00618dd9-365c-4fd8-ac04-da437edc6189', 'a3c5345b-f941-41a5-8b99-d7782257644e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342510592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.manager [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Deleted volume successfully. Apr 14 00:06:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-14eb7d25-677a-4832-a9b7-7fb2dafca6f6 tempest-VolumesCloneTest-662478684 None] Lock "cinder-e17fed6f-1301-437a-8346-5af70af0cdb6-delete_volume" released by "delete_volume" :: held 2.986s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (ecf877f1-a549-4948-91e4-8b5824fecc39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b716eb-da90-41fc-b4ab-9d4264e6d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b716eb-da90-41fc-b4ab-9d4264e6d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2083517678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1f278353-ffe0-430c-ba55-fe9b6b730471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:37Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb0a30a-783b-4632-ab8c-541ce69f17e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb0a30a-783b-4632-ab8c-541ce69f17e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8b7b54-7185-41df-bc0c-a8680044cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8b7b54-7185-41df-bc0c-a8680044cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f278353-ffe0-430c-ba55-fe9b6b730471', 'volume_name': 'volume-1f278353-ffe0-430c-ba55-fe9b6b730471', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e627ce96-c56e-4304-abc1-f78bd9c5ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e627ce96-c56e-4304-abc1-f78bd9c5ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7b7e9b-50bb-4b14-9400-4c03dc6d55eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Volume 1f278353-ffe0-430c-ba55-fe9b6b730471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f278353-ffe0-430c-ba55-fe9b6b730471', 'volume_size': 1} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] creating volume v_1f278353-ffe0-430c-ba55-fe9b6b730471. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] create volume {'name': 'v_1f278353-ffe0-430c-ba55-fe9b6b730471', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1f278353-ffe0-430c-ba55-fe9b6b730471', 'is_clone': False, 'name': 'v_1f278353-ffe0-430c-ba55-fe9b6b730471'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee7b7e9b-50bb-4b14-9400-4c03dc6d55eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f278353-ffe0-430c-ba55-fe9b6b730471', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8695208-4474-4b7c-8a8e-6c75c1b31be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Volume volume-1f278353-ffe0-430c-ba55-fe9b6b730471 (1f278353-ffe0-430c-ba55-fe9b6b730471): created successfully Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8695208-4474-4b7c-8a8e-6c75c1b31be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (ecf877f1-a549-4948-91e4-8b5824fecc39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d477f1e1-e231-4ba6-bb6e-4a96c5ad8802 tempest-VolumesCloneTest-662478684 None] Created volume successfully. Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (ff6a3300-ced0-4e2f-81cc-d9613250f172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e8b7dd-ef3c-4ff9-8fa5-3ee987bca95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e8b7dd-ef3c-4ff9-8fa5-3ee987bca95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-762307923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=615efb3a-31fb-422d-bb46-c08320f46dca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1f278353-ffe0-430c-ba55-fe9b6b730471,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:39Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5e0bdf-0093-41fb-b2a8-cfc7bcad4124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5e0bdf-0093-41fb-b2a8-cfc7bcad4124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719d4e73-2e4e-4363-b1c1-8b93e32fa8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (719d4e73-2e4e-4363-b1c1-8b93e32fa8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '615efb3a-31fb-422d-bb46-c08320f46dca', 'volume_name': 'volume-615efb3a-31fb-422d-bb46-c08320f46dca', 'volume_size': 2, 'source_volid': '1f278353-ffe0-430c-ba55-fe9b6b730471', 'source_volstatus': 'available'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5e70db-7364-41ad-8fc4-151743d1d2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5e70db-7364-41ad-8fc4-151743d1d2d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096dfc9e-6ef2-4f55-9996-704f92266486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Volume 615efb3a-31fb-422d-bb46-c08320f46dca: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-615efb3a-31fb-422d-bb46-c08320f46dca', 'volume_size': 2, 'source_volid': '1f278353-ffe0-430c-ba55-fe9b6b730471', 'source_volstatus': 'available'} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] cloned volume 1f278353-ffe0-430c-ba55-fe9b6b730471 to 615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] cloning v_1f278353-ffe0-430c-ba55-fe9b6b730471 to v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] create snapshot v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_615efb3a-31fb-422d-bb46-c08320f46dca'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] create volume v_615efb3a-31fb-422d-bb46-c08320f46dca from snapshot v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:06:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1f278353-ffe0-430c-ba55-fe9b6b730471@v_615efb3a-31fb-422d-bb46-c08320f46dca', 'is_clone': True, 'full_name': 'Pool-0/v_615efb3a-31fb-422d-bb46-c08320f46dca', 'name': 'v_615efb3a-31fb-422d-bb46-c08320f46dca'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] get volume v_615efb3a-31fb-422d-bb46-c08320f46dca info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1f278353-ffe0-430c-ba55-fe9b6b730471@v_615efb3a-31fb-422d-bb46-c08320f46dca', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_615efb3a-31fb-422d-bb46-c08320f46dca', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432209', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107839', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12150262980413537135', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cc1fe96f42b50eb6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342416384', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79052', 'name': 'v_615efb3a-31fb-422d-bb46-c08320f46dca', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Extend volume 615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] jdss extend volume v_615efb3a-31fb-422d-bb46-c08320f46dca to 2147483648 {{(pid=84560) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096dfc9e-6ef2-4f55-9996-704f92266486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615efb3a-31fb-422d-bb46-c08320f46dca', 'volume_size': 2, 'source_volid': '1f278353-ffe0-430c-ba55-fe9b6b730471', 'source_volstatus': 'available'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a7bf3c-f3dd-44ed-9e59-437839e5d9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Volume volume-615efb3a-31fb-422d-bb46-c08320f46dca (615efb3a-31fb-422d-bb46-c08320f46dca): created successfully Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a7bf3c-f3dd-44ed-9e59-437839e5d9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Flow 'volume_create_manager' (ff6a3300-ced0-4e2f-81cc-d9613250f172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a9d5c585-4f5f-41d4-b738-fdcde7596e41 tempest-VolumesCloneTest-662478684 None] Created volume successfully. Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Acquiring lock "cinder-615efb3a-31fb-422d-bb46-c08320f46dca-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Lock "cinder-615efb3a-31fb-422d-bb46-c08320f46dca-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] remove_export for volume: 615efb3a-31fb-422d-bb46-c08320f46dca. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-762307923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=615efb3a-31fb-422d-bb46-c08320f46dca,launched_at=2023-04-14T00:06:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth='CHAP GLsrDpXQ 6J3rkjL81oyFuR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:39Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1f278353-ffe0-430c-ba55-fe9b6b730471,status='deleting',terminated_at=2023-04-14T00:06:42Z,updated_at=2023-04-14T00:06:42Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] detach volume v_615efb3a-31fb-422d-bb46-c08320f46dca from target iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca/luns/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca/luns/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca/luns/v_615efb3a-31fb-422d-bb46-c08320f46dca'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca/luns/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca because of JDSS resource v_615efb3a-31fb-422d-bb46-c08320f46dca DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] delete target: iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] delete target iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca because of JDSS resource iqn.2010-10.org.openstack:615efb3a-31fb-422d-bb46-c08320f46dca DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] deleating volume v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] get snapshots for volume v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] get volume v_615efb3a-31fb-422d-bb46-c08320f46dca info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1f278353-ffe0-430c-ba55-fe9b6b730471@v_615efb3a-31fb-422d-bb46-c08320f46dca', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_615efb3a-31fb-422d-bb46-c08320f46dca', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432209', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107839', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12150262980413537135', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cc1fe96f42b50eb6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342322176', 'san:volume_id': 'cc1fe96f42b50eb6b741ff227d3819f09abfa94b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79052', 'name': 'v_615efb3a-31fb-422d-bb46-c08320f46dca', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] delete snapshot v_615efb3a-31fb-422d-bb46-c08320f46dca of volume v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots/v_615efb3a-31fb-422d-bb46-c08320f46dca {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] snapshot v_615efb3a-31fb-422d-bb46-c08320f46dca deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.quota [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Created reservations ['bf2e9e77-2552-4a8e-a6de-7adc44472eee', '1fa1d762-2749-4a21-a7ef-cb5a7ae89f85', '46bb7158-0a60-4130-a8bb-03efb848980b', 'ba3b0b7b-dc5a-42d4-87a6-58402a896ec9'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Flow 'volume_create_manager' (faedc95c-e1b0-4c4f-8f8b-e1f966f43772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55cc8de-ef7f-49e0-92aa-abed22a48b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c55cc8de-ef7f-49e0-92aa-abed22a48b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1209941562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9751d47f-616e-4dc7-b5c5-910ddde3d0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834d867e665a4671a901218d21fa8704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:44Z,use_quota=True,user_id='457273b82bcb4fa6bbee81fdd9e0265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55551030-986a-462d-8560-3901819dc99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55551030-986a-462d-8560-3901819dc99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931c5997-834e-47c5-80c2-7589c98bb67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931c5997-834e-47c5-80c2-7589c98bb67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'volume_name': 'volume-9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18cd8b2-0177-447d-a62b-911bf8406d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b18cd8b2-0177-447d-a62b-911bf8406d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeee4b5-4d18-494a-82b0-0077a15d5b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:44 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Volume 9751d47f-616e-4dc7-b5c5-910ddde3d0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'volume_size': 1} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] creating volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] create volume {'name': 'v_9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Acquiring lock "cinder-1f278353-ffe0-430c-ba55-fe9b6b730471-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Lock "cinder-1f278353-ffe0-430c-ba55-fe9b6b730471-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] remove_export for volume: 1f278353-ffe0-430c-ba55-fe9b6b730471. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2083517678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1f278353-ffe0-430c-ba55-fe9b6b730471,launched_at=2023-04-14T00:06:38Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aa348992d8e465a9b84c02c029a0ab1',provider_auth='CHAP WZIgAScr 1vB8jbPfxJ75Nz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:37Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:44Z,updated_at=2023-04-14T00:06:44Z,use_quota=True,user_id='43b76125236d4e5eb864e4445673e14c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] detach volume v_1f278353-ffe0-430c-ba55-fe9b6b730471 from target iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471/luns/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471/luns/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471/luns/v_1f278353-ffe0-430c-ba55-fe9b6b730471'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471/luns/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 because of JDSS resource v_1f278353-ffe0-430c-ba55-fe9b6b730471 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] delete target: iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] delete target iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] failed to remove resource iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 because of JDSS resource iqn.2010-10.org.openstack:1f278353-ffe0-430c-ba55-fe9b6b730471 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] deleating volume v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] get snapshots for volume v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342416384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.manager [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:44 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Deleted volume successfully. Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f6369772-5fbd-4383-b109-10e47f520afe tempest-VolumesCloneTest-662478684 None] Lock "cinder-615efb3a-31fb-422d-bb46-c08320f46dca-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] get volume v_1f278353-ffe0-430c-ba55-fe9b6b730471 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1f278353-ffe0-430c-ba55-fe9b6b730471', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432207', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107833', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17017977758576636803', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '58e58488d3ce3511', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342334464', 'san:volume_id': '58e58488d3ce35112de27b166db4e287123513da', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79039', 'name': 'v_1f278353-ffe0-430c-ba55-fe9b6b730471', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] delete volume:v_1f278353-ffe0-430c-ba55-fe9b6b730471 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'is_clone': False, 'name': 'v_9751d47f-616e-4dc7-b5c5-910ddde3d0af'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeee4b5-4d18-494a-82b0-0077a15d5b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece9b13e-b39d-4183-8eeb-0c7531ad1f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:45 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Volume volume-9751d47f-616e-4dc7-b5c5-910ddde3d0af (9751d47f-616e-4dc7-b5c5-910ddde3d0af): created successfully Apr 14 00:06:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece9b13e-b39d-4183-8eeb-0c7531ad1f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Flow 'volume_create_manager' (faedc95c-e1b0-4c4f-8f8b-e1f966f43772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:45 user cinder-volume[84560]: INFO cinder.volume.manager [None req-559856db-e40e-49cf-9297-750e5a354027 tempest-DeleteServersTestJSON-1615746799 None] Created volume successfully. Apr 14 00:06:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=57,cinder:INSERT=6,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1f278353-ffe0-430c-ba55-fe9b6b730471 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] volume v_1f278353-ffe0-430c-ba55-fe9b6b730471 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.quota [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Created reservations ['54ee5884-59e3-403f-b043-697a5ef9a6f0', '8c9a5d2f-95e1-4eec-8606-0b3f576aae47', '09819d9a-2f06-4474-aefe-df45f9eaec82', '7e6e3c6d-1dc8-4415-8196-0b59163b359d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342416384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:47 user cinder-volume[84560]: DEBUG cinder.manager [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Deleted volume successfully. Apr 14 00:06:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-87d662ee-4d13-4c80-acd6-c75e25db0765 tempest-VolumesCloneTest-662478684 None] Lock "cinder-1f278353-ffe0-430c-ba55-fe9b6b730471-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] create export for volume: 9751d47f-616e-4dc7-b5c5-910ddde3d0af. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] ensure volume 9751d47f-616e-4dc7-b5c5-910ddde3d0af assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] check if targe iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] create target and attach volume 9751d47f-616e-4dc7-b5c5-910ddde3d0af to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] create target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Flow 'volume_create_manager' (f0796630-dcc7-4f20-b979-c45bae430d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee5099-2aec-426d-aa50-b2a7ab1cf6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:DELETE=5,cinder:SELECT=58,cinder:INSERT=7,cinder:UPDATE=30 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beee5099-2aec-426d-aa50-b2a7ab1cf6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-589201394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c1d196b5-82f5-4450-9e7d-31b73d9519f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d80c57763e44e3998e0714589a8278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:50Z,use_quota=True,user_id='99299f0744c74851804ab6d41c796a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8fef3f-e109-49a0-819e-bbf777684497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e8fef3f-e109-49a0-819e-bbf777684497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e69a6-deb7-43d5-9959-4f1b7687b786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e69a6-deb7-43d5-9959-4f1b7687b786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'volume_name': 'volume-c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806e196f-d4e2-499a-a0de-2bba04099c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806e196f-d4e2-499a-a0de-2bba04099c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7d5c61-0205-495c-8b56-fee303493213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Volume c1d196b5-82f5-4450-9e7d-31b73d9519f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Cloning c1d196b5-82f5-4450-9e7d-31b73d9519f6 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 6, 50, 831031)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.084s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 6, 50, 910761)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] create snapshot v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Flow 'volume_create_manager' (dd16c6d2-9948-487a-a94c-bb85862f9aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13434a9-e372-42f7-be62-e9ff54607c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "cinder-20a8a1b6-5d63-4d2b-b3b1-a642c0690120-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13434a9-e372-42f7-be62-e9ff54607c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-155776098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5021c122-fea0-4125-8b1f-c1ab3c4de5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:52Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56dcbec-8b26-4e59-bbd9-85271cad3f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56dcbec-8b26-4e59-bbd9-85271cad3f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee3f4ac-dc96-4702-a923-75cdade366a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee3f4ac-dc96-4702-a923-75cdade366a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'volume_name': 'volume-5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac1079b-e80b-4bfd-b161-e01b572b8d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ac1079b-e80b-4bfd-b161-e01b572b8d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c6896-3910-4d97-a6cc-36f7d448bf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Volume 5021c122-fea0-4125-8b1f-c1ab3c4de5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'volume_size': 1} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] creating volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] create volume {'name': 'v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-20a8a1b6-5d63-4d2b-b3b1-a642c0690120-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] remove_export for volume: 20a8a1b6-5d63-4d2b-b3b1-a642c0690120. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-367077710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=20a8a1b6-5d63-4d2b-b3b1-a642c0690120,launched_at=2023-04-14T00:05:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth='CHAP bANwnLlz LiAnfBR1UWJKcv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:36Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:52Z,updated_at=2023-04-14T00:06:52Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] detach volume v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 from target iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120/luns/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120/luns/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Flow 'volume_create_manager' (ef846bf9-0473-4444-997b-b044a13bd967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c3a745-a28c-4f72-be15-ade5027a6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c3a745-a28c-4f72-be15-ade5027a6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1863658117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=af1b05d2-717a-489c-8bdf-160d00ebd122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20caf676a64b9b97027f3fc9bc724c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:06:52Z,use_quota=True,user_id='2f8b18d40ecd4b4e976cf2018af8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297bcd74-cd4e-4d03-9675-c976e2495598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297bcd74-cd4e-4d03-9675-c976e2495598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a23424-a3c0-4414-bc18-c0f01469590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a23424-a3c0-4414-bc18-c0f01469590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af1b05d2-717a-489c-8bdf-160d00ebd122', 'volume_name': 'volume-af1b05d2-717a-489c-8bdf-160d00ebd122', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aaf156f-ed9c-478b-8f13-9be473c32193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aaf156f-ed9c-478b-8f13-9be473c32193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f15b348-3bdf-4407-a6da-a2c37386f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Volume af1b05d2-717a-489c-8bdf-160d00ebd122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af1b05d2-717a-489c-8bdf-160d00ebd122', 'volume_size': 1} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] creating volume v_af1b05d2-717a-489c-8bdf-160d00ebd122. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] create volume {'name': 'v_af1b05d2-717a-489c-8bdf-160d00ebd122', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] atach volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af to target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'is_clone': False, 'name': 'v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c6896-3910-4d97-a6cc-36f7d448bf17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebe74e5-249b-458b-9b52-b3f0074e9e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120/luns/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120/luns/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] failed to remove resource iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 because of JDSS resource v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] delete target: iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] delete target iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Volume volume-5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (5021c122-fea0-4125-8b1f-c1ab3c4de5e7): created successfully Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebe74e5-249b-458b-9b52-b3f0074e9e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Flow 'volume_create_manager' (dd16c6d2-9948-487a-a94c-bb85862f9aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cfc3dd18-9856-41d0-a432-644a7fa31968 tempest-AttachVolumeTestJSON-1885059489 None] Created volume successfully. Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] failed to remove resource iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 because of JDSS resource iqn.2010-10.org.openstack:20a8a1b6-5d63-4d2b-b3b1-a642c0690120 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] deleating volume v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] get snapshots for volume v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_af1b05d2-717a-489c-8bdf-160d00ebd122', 'is_clone': False, 'name': 'v_af1b05d2-717a-489c-8bdf-160d00ebd122'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f15b348-3bdf-4407-a6da-a2c37386f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af1b05d2-717a-489c-8bdf-160d00ebd122', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7994ee5d-41c5-422b-b44e-42640dfb01a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:53 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Volume volume-af1b05d2-717a-489c-8bdf-160d00ebd122 (af1b05d2-717a-489c-8bdf-160d00ebd122): created successfully Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7994ee5d-41c5-422b-b44e-42640dfb01a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Flow 'volume_create_manager' (ef846bf9-0473-4444-997b-b044a13bd967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d4be52d6-e988-4c4f-a810-3b2a1279db69 tempest-AttachVolumeShelveTestJSON-1395403129 None] Created volume successfully. Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] get volume v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432145', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107762', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7790116642607664287', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ced300fed2ce85dc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342264832', 'san:volume_id': 'ced300fed2ce85dcc01992191648ebf6cccfb7a3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '77307', 'name': 'v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] delete volume:v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c1d196b5-82f5-4450-9e7d-31b73d9519f6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] create volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 from snapshot v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] create export for volume: 5021c122-fea0-4125-8b1f-c1ab3c4de5e7. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] ensure volume 5021c122-fea0-4125-8b1f-c1ab3c4de5e7 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] check if targe iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] create target and attach volume 5021c122-fea0-4125-8b1f-c1ab3c4de5e7 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] create target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3930636336626539', 'lun': 0, 'mode': 'wt', 'name': 'v_9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'prod_id': 'Storage', 'scsi_id': '90cc6be992e3ce73'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] add credentails to target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] volume v_20a8a1b6-5d63-4d2b-b3b1-a642c0690120 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.quota [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Created reservations ['cdbe6aa4-9f3c-400c-a617-c0fc71deec5a', 'a061b694-b7b1-4492-be3b-201e49a1fae6', '2d240f69-d4a2-4064-9787-2d4726f6a27b', 'cf3aacd6-57cc-4eb6-a085-3821fb82879a'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'is_clone': True, 'full_name': 'Pool-0/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'name': 'v_c1d196b5-82f5-4450-9e7d-31b73d9519f6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] get volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342309888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.manager [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:56 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Deleted volume successfully. Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3e6f4edf-1464-42ea-a26b-8d256b754a54 tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-20a8a1b6-5d63-4d2b-b3b1-a642c0690120-delete_volume" released by "delete_volume" :: held 4.180s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BRmkKrYn'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] initialize_connection for 9751d47f-616e-4dc7-b5c5-910ddde3d0af 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRmkKrYn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7dbb1711-7390-4b6c-b65c-c7883e0f33d4'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "cinder-c61b919a-21cb-438b-aa6a-9876ba06231d-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432224', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107868', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12260372687454281860', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b7d67adb682d98b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342309888', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79102', 'name': 'v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Marking volume c1d196b5-82f5-4450-9e7d-31b73d9519f6 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to c1d196b5-82f5-4450-9e7d-31b73d9519f6. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Creating volume glance metadata for volume c1d196b5-82f5-4450-9e7d-31b73d9519f6 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-c61b919a-21cb-438b-aa6a-9876ba06231d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:56 user cinder-volume[84560]: INFO cinder.volume.manager [req-cac2c424-b423-4f1c-8611-0959c7f24045 req-40893e90-3dc3-496d-81c3-a978c75cd465 tempest-DeleteServersTestJSON-1615746799 None] attachment_update completed successfully. Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] remove_export for volume: c61b919a-21cb-438b-aa6a-9876ba06231d. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-852164644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c61b919a-21cb-438b-aa6a-9876ba06231d,launched_at=2023-04-14T00:05:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth='CHAP NdXbsmRD yfqaHxK8QFAo67',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:33Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:56Z,updated_at=2023-04-14T00:06:56Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] detach volume v_c61b919a-21cb-438b-aa6a-9876ba06231d from target iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d/luns/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d/luns/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f7d5c61-0205-495c-8b56-fee303493213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e595c4-8027-43af-bc22-16dbe2d39926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d/luns/v_c61b919a-21cb-438b-aa6a-9876ba06231d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d/luns/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] failed to remove resource iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d because of JDSS resource v_c61b919a-21cb-438b-aa6a-9876ba06231d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] delete target: iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] delete target iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:56 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Volume volume-c1d196b5-82f5-4450-9e7d-31b73d9519f6 (c1d196b5-82f5-4450-9e7d-31b73d9519f6): created successfully Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e595c4-8027-43af-bc22-16dbe2d39926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Flow 'volume_create_manager' (f0796630-dcc7-4f20-b979-c45bae430d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=63,cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] failed to remove resource iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d because of JDSS resource iqn.2010-10.org.openstack:c61b919a-21cb-438b-aa6a-9876ba06231d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] deleating volume v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] get snapshots for volume v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:56 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2db55d0d-6a8f-4069-9c8f-e24b714957c4 tempest-VolumesExtendTest-1766020092 None] Created volume successfully. Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] get volume v_c61b919a-21cb-438b-aa6a-9876ba06231d info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c61b919a-21cb-438b-aa6a-9876ba06231d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432143', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107754', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7022724596669184035', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9e3dd37a48b4d505', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342285312', 'san:volume_id': '9e3dd37a48b4d505ff73387d03596ddf98ef2c59', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78272', 'name': 'v_c61b919a-21cb-438b-aa6a-9876ba06231d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] delete volume:v_c61b919a-21cb-438b-aa6a-9876ba06231d recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0861f2d9-18f1-453e-92c3-d27b73f2ad77 tempest-VolumesExtendTest-1766020092 None] Extend volume c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0861f2d9-18f1-453e-92c3-d27b73f2ad77 tempest-VolumesExtendTest-1766020092 None] jdss extend volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 to 2147483648 {{(pid=84560) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0861f2d9-18f1-453e-92c3-d27b73f2ad77 tempest-VolumesExtendTest-1766020092 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0861f2d9-18f1-453e-92c3-d27b73f2ad77 tempest-VolumesExtendTest-1766020092 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] atach volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 to target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:06:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c61b919a-21cb-438b-aa6a-9876ba06231d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] volume v_c61b919a-21cb-438b-aa6a-9876ba06231d deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.quota [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Created reservations ['2bb61eb7-afa4-401a-bf53-ffe9a6388bd7', 'a98b7205-e787-43aa-b49e-425501d34d4e', '80dee724-eb85-4d28-872b-e4e6826513f7', '2fbf1430-c0dc-42bf-a1a1-7ff97a8cb621'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=60,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=10 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Acquiring lock "cinder-f1a3323a-058c-4e1d-8627-04fbfb2310bd-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0861f2d9-18f1-453e-92c3-d27b73f2ad77 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-f1a3323a-058c-4e1d-8627-04fbfb2310bd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3866316530316134', 'lun': 0, 'mode': 'wt', 'name': 'v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'prod_id': 'Storage', 'scsi_id': '8f1e01a4693a5b73'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] add credentails to target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0861f2d9-18f1-453e-92c3-d27b73f2ad77 tempest-VolumesExtendTest-1766020092 None] Extend volume completed successfully. Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] remove_export for volume: f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1850807687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f1a3323a-058c-4e1d-8627-04fbfb2310bd,launched_at=2023-04-14T00:05:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8a7ace23ccb4c41b76a80532b3997b9',provider_auth='CHAP tyRSPHDJ wjBE9SrzQ53p2q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:05Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:59Z,updated_at=2023-04-14T00:06:59Z,use_quota=True,user_id='f5613db231764f7c8c2ac461cf751d8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] detach volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd from target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'name': 'npILkxwF'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] initialize_connection for 5021c122-fea0-4125-8b1f-c1ab3c4de5e7 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:06:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'npILkxwF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '3ee3e773-1a7c-47ce-b628-8897d5895513'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:06:59 user cinder-volume[84560]: INFO cinder.volume.manager [req-5e257c7e-e054-4f8b-97ad-a7a036c0d919 req-342d7f73-bb67-45d9-8217-48346d83ef08 tempest-AttachVolumeTestJSON-1885059489 None] attachment_update completed successfully. Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Acquiring lock "cinder-c1d196b5-82f5-4450-9e7d-31b73d9519f6-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Lock "cinder-c1d196b5-82f5-4450-9e7d-31b73d9519f6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342297600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.manager [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:06:59 user cinder-volume[84560]: INFO cinder.volume.manager [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Deleted volume successfully. Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd/luns/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] failed to remove resource iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd because of JDSS resource v_f1a3323a-058c-4e1d-8627-04fbfb2310bd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] delete target: iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] delete target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] remove_export for volume: c1d196b5-82f5-4450-9e7d-31b73d9519f6. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-589201394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c1d196b5-82f5-4450-9e7d-31b73d9519f6,launched_at=2023-04-14T00:06:56Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='98d80c57763e44e3998e0714589a8278',provider_auth='CHAP gfHWMSQw Tw4yQWgSaUCsi2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:50Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:06:59Z,updated_at=2023-04-14T00:06:59Z,use_quota=True,user_id='99299f0744c74851804ab6d41c796a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] detach volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 from target iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6/luns/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6/luns/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-63fefc3f-945e-4481-89f0-74c6bae652e9 tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-c61b919a-21cb-438b-aa6a-9876ba06231d-delete_volume" released by "delete_volume" :: held 3.300s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] failed to remove resource iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd because of JDSS resource iqn.2010-10.org.openstack:f1a3323a-058c-4e1d-8627-04fbfb2310bd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] deleating volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] get snapshots for volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6/luns/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6/luns/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] failed to remove resource iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 because of JDSS resource v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] delete target: iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] delete target iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:06:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '16285696', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:28:59', 'volsize': '1073741824', 'createtxg': '107743', 'guid': '16172266269288701293', 'compressratio': '1.17', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '16285696', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.17', 'fscontext': 'none', 'clones': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507', 'objsetid': '76405', 'name': 'v_27b4700f-a1b7-4450-8b39-5270a460f507', 'defer_destroy': 'off', 'san:volume_id': '8e2f6f3044c1a3e42905fe1e3e6cbe269234ae15', 'mlslabel': 'none', 'logicalreferenced': '19042304', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] failed to remove resource iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 because of JDSS resource iqn.2010-10.org.openstack:c1d196b5-82f5-4450-9e7d-31b73d9519f6 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] deleating volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] get snapshots for volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f1a3323a-058c-4e1d-8627-04fbfb2310bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] volume v_f1a3323a-058c-4e1d-8627-04fbfb2310bd updated {{(pid=84560) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.quota [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Created reservations ['c939fc8d-dbf8-441b-9542-fd6f45123d3f', '7663af44-538f-4a06-8988-314f258890d0', '47a458a2-4b2e-4e1b-9b7e-6e14faab6d1c', '07c75563-209f-407e-a23d-5562a389b859'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] get volume v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] terminate connection for 9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:02 user cinder-volume[84560]: INFO cinder.volume.manager [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Terminate volume connection completed successfully. Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Deleting attachment 7dbb1711-7390-4b6c-b65c-c7883e0f33d4. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] remove_export for volume: 9751d47f-616e-4dc7-b5c5-910ddde3d0af. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1209941562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9751d47f-616e-4dc7-b5c5-910ddde3d0af,launched_at=2023-04-14T00:06:45Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='834d867e665a4671a901218d21fa8704',provider_auth='CHAP BRmkKrYn cIwyK0pY7QtNRZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:44Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:07:00Z,use_quota=True,user_id='457273b82bcb4fa6bbee81fdd9e0265c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] detach volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af from target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342297600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.manager [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:07:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Deleted volume successfully. Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6f48d7a9-bbce-4a32-a08e-c7dc52ed453b tempest-TaggedBootDevicesTest-1396120968 None] Lock "cinder-f1a3323a-058c-4e1d-8627-04fbfb2310bd-delete_volume" released by "delete_volume" :: held 3.848s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432224', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '107868', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12260372687454281860', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b7d67adb682d98b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342297600', 'san:volume_id': '7b7d67adb682d98b3d3940908d6e08982a70a961', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79102', 'name': 'v_c1d196b5-82f5-4450-9e7d-31b73d9519f6', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] delete snapshot v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] delete target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] delete target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17a7504a-6118-4ec8-bf28-393ebe927145 req-e6c6d571-5995-43e2-926c-8eb6e25799df tempest-DeleteServersTestJSON-1615746799 None] target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] snapshot v_c1d196b5-82f5-4450-9e7d-31b73d9519f6 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.quota [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Created reservations ['6c8d4c7a-caa5-45c4-91ba-2d1292b5ad6a', '5f94a61a-bb93-4520-ba46-97b05f5e890b', 'd746d8e9-aa13-441d-a035-0044bcb1fccb', '2b9fbd66-96a0-45cb-ad5d-5f6d9d6f3aa6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342404096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.manager [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:07:04 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Deleted volume successfully. Apr 14 00:07:04 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4f829933-2e55-42e6-b458-850b9f6c8f99 tempest-VolumesExtendTest-1766020092 None] Lock "cinder-c1d196b5-82f5-4450-9e7d-31b73d9519f6-delete_volume" released by "delete_volume" :: held 5.373s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Flow 'volume_create_manager' (c5be492f-d742-4e00-8a51-dd83ecc26482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc7bc2a-52ec-4e79-a4c3-64363815fbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fc7bc2a-52ec-4e79-a4c3-64363815fbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1052504525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=14cd8007-5250-4639-a997-7437dda8a470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98d80c57763e44e3998e0714589a8278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:07:05Z,use_quota=True,user_id='99299f0744c74851804ab6d41c796a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678b2fc7-837f-4289-a9bc-67f94491422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (678b2fc7-837f-4289-a9bc-67f94491422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0320cfb0-5379-4c6f-aa3a-07b544959071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0320cfb0-5379-4c6f-aa3a-07b544959071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14cd8007-5250-4639-a997-7437dda8a470', 'volume_name': 'volume-14cd8007-5250-4639-a997-7437dda8a470', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d9ffe3-51d0-4efd-9051-bc04d2571485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80d9ffe3-51d0-4efd-9051-bc04d2571485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9bec1-e33b-4d7c-9730-0bd3667ca33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:05 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Volume 14cd8007-5250-4639-a997-7437dda8a470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14cd8007-5250-4639-a997-7437dda8a470', 'volume_size': 1} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] creating volume v_14cd8007-5250-4639-a997-7437dda8a470. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] create volume {'name': 'v_14cd8007-5250-4639-a997-7437dda8a470', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_14cd8007-5250-4639-a997-7437dda8a470', 'is_clone': False, 'name': 'v_14cd8007-5250-4639-a997-7437dda8a470'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9bec1-e33b-4d7c-9730-0bd3667ca33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14cd8007-5250-4639-a997-7437dda8a470', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392ca0f4-c3cf-4594-ba18-63657e2458fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:05 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Volume volume-14cd8007-5250-4639-a997-7437dda8a470 (14cd8007-5250-4639-a997-7437dda8a470): created successfully Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392ca0f4-c3cf-4594-ba18-63657e2458fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Flow 'volume_create_manager' (c5be492f-d742-4e00-8a51-dd83ecc26482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:06 user cinder-volume[84560]: INFO cinder.volume.manager [None req-59ab43b8-596e-4731-bcd5-05061343fd9a tempest-VolumesExtendTest-1766020092 None] Created volume successfully. Apr 14 00:07:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] create snapshot 19a304e5-107f-49b6-a639-d7d6c0b93699 for volume 14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:07:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] cloning v_14cd8007-5250-4639-a997-7437dda8a470 to s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:07:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] create snapshot s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:07:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_19a304e5-107f-49b6-a639-d7d6c0b93699'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] create volume s_19a304e5-107f-49b6-a639-d7d6c0b93699 from snapshot s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:07:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_14cd8007-5250-4639-a997-7437dda8a470@s_19a304e5-107f-49b6-a639-d7d6c0b93699', 'is_clone': True, 'full_name': 'Pool-0/s_19a304e5-107f-49b6-a639-d7d6c0b93699', 'name': 's_19a304e5-107f-49b6-a639-d7d6c0b93699'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] volume s_19a304e5-107f-49b6-a639-d7d6c0b93699 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:07:08 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8b3d51ba-5450-4491-94f3-82f8d1e4b19b tempest-VolumesExtendTest-1766020092 None] Create snapshot completed successfully Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b72eaee2-d2bc-466c-bb27-d80486478bc4 tempest-VolumesExtendTest-1766020092 None] Extend volume 14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b72eaee2-d2bc-466c-bb27-d80486478bc4 tempest-VolumesExtendTest-1766020092 None] jdss extend volume v_14cd8007-5250-4639-a997-7437dda8a470 to 2147483648 {{(pid=84560) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b72eaee2-d2bc-466c-bb27-d80486478bc4 tempest-VolumesExtendTest-1766020092 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b72eaee2-d2bc-466c-bb27-d80486478bc4 tempest-VolumesExtendTest-1766020092 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b72eaee2-d2bc-466c-bb27-d80486478bc4 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:08 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:INSERT=5,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:08 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b72eaee2-d2bc-466c-bb27-d80486478bc4 tempest-VolumesExtendTest-1766020092 None] Extend volume completed successfully. Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Acquiring lock "cinder-19a304e5-107f-49b6-a639-d7d6c0b93699-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Lock "cinder-19a304e5-107f-49b6-a639-d7d6c0b93699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] deleating snapshot s_19a304e5-107f-49b6-a639-d7d6c0b93699. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] get snapshots for volume s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] get volume s_19a304e5-107f-49b6-a639-d7d6c0b93699 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_14cd8007-5250-4639-a997-7437dda8a470@s_19a304e5-107f-49b6-a639-d7d6c0b93699', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_19a304e5-107f-49b6-a639-d7d6c0b93699', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432237', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107890', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11180454721968740808', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2510ff9f8072575a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342215680', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79259', 'name': 's_19a304e5-107f-49b6-a639-d7d6c0b93699', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] delete snapshot s_19a304e5-107f-49b6-a639-d7d6c0b93699 of volume v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots/s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots/s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots/s_19a304e5-107f-49b6-a639-d7d6c0b93699 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] snapshot s_19a304e5-107f-49b6-a639-d7d6c0b93699 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:07:12 user cinder-volume[84560]: WARNING cinder.quota [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Deprecated: Default quota for resource: snapshots_joviandss-2 is set by the default quota flag: quota_snapshots_joviandss-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.quota [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Created reservations ['d01fdfeb-262c-423f-9fad-a0a66259f22c', '697d55bc-6b4a-4c11-8bad-9ee4b978a0a4', 'd3eead97-3c2c-417d-8e57-2193865ad260', '16ddc4a8-0a5b-461d-bf0b-82296ee8e325'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:12 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Delete snapshot completed successfully. Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2f3f0243-cbee-4a78-8cc3-fd5d499b66ce tempest-VolumesExtendTest-1766020092 None] Lock "cinder-19a304e5-107f-49b6-a639-d7d6c0b93699-delete_snapshot" released by "delete_snapshot" :: held 1.997s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Acquiring lock "cinder-14cd8007-5250-4639-a997-7437dda8a470-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Lock "cinder-14cd8007-5250-4639-a997-7437dda8a470-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] remove_export for volume: 14cd8007-5250-4639-a997-7437dda8a470. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1052504525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=14cd8007-5250-4639-a997-7437dda8a470,launched_at=2023-04-14T00:07:06Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='98d80c57763e44e3998e0714589a8278',provider_auth='CHAP ezLZTHqv t3ciwVLveJlAaD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:05Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:07:12Z,updated_at=2023-04-14T00:07:12Z,use_quota=True,user_id='99299f0744c74851804ab6d41c796a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] detach volume v_14cd8007-5250-4639-a997-7437dda8a470 from target iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470/luns/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470/luns/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470/luns/v_14cd8007-5250-4639-a997-7437dda8a470'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470/luns/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] failed to remove resource iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 because of JDSS resource v_14cd8007-5250-4639-a997-7437dda8a470 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] delete target: iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] delete target iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] failed to remove resource iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 because of JDSS resource iqn.2010-10.org.openstack:14cd8007-5250-4639-a997-7437dda8a470 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] deleating volume v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] get snapshots for volume v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] get volume v_14cd8007-5250-4639-a997-7437dda8a470 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_14cd8007-5250-4639-a997-7437dda8a470', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432235', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107884', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17343686842470848154', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '64202c4a7795583e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342297600', 'san:volume_id': '64202c4a7795583e0300395b299c6733d5f5cda5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79109', 'name': 'v_14cd8007-5250-4639-a997-7437dda8a470', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] delete volume:v_14cd8007-5250-4639-a997-7437dda8a470 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=64,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Flow 'volume_create_manager' (0335c22c-b551-4cc1-84b8-c7006c3e7f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e724b6c1-c96a-46e6-a75b-5361e4580cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e724b6c1-c96a-46e6-a75b-5361e4580cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1024595318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0c69fa38-1485-41bd-922c-993c12dc3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccde4d67c2ed45af968e5f219cc8b6c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:07:14Z,use_quota=True,user_id='b3bff58a90484c5db3f035ab1187080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb52e40a-3da0-4561-8214-49b9acdfcde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb52e40a-3da0-4561-8214-49b9acdfcde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fc9fd0-be26-431d-9555-80700a02c893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90fc9fd0-be26-431d-9555-80700a02c893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c69fa38-1485-41bd-922c-993c12dc3b53', 'volume_name': 'volume-0c69fa38-1485-41bd-922c-993c12dc3b53', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68bb8aa-366e-4447-b0d1-f45b68538b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68bb8aa-366e-4447-b0d1-f45b68538b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1171cf53-e384-4cf6-8e58-4e08d675475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Volume 0c69fa38-1485-41bd-922c-993c12dc3b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c69fa38-1485-41bd-922c-993c12dc3b53', 'volume_size': 1} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] creating volume v_0c69fa38-1485-41bd-922c-993c12dc3b53. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] create volume {'name': 'v_0c69fa38-1485-41bd-922c-993c12dc3b53', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14cd8007-5250-4639-a997-7437dda8a470 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] volume v_14cd8007-5250-4639-a997-7437dda8a470 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.quota [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Created reservations ['05051e63-544b-4480-a47d-12d0b226cd64', '623e2a20-2d0f-4971-8885-c116b3b1d14a', '68640ebe-a031-4830-9162-a41ad5dda21a', '853fe3a3-47dc-4dd3-ac4e-2db9bfe15137'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0c69fa38-1485-41bd-922c-993c12dc3b53', 'is_clone': False, 'name': 'v_0c69fa38-1485-41bd-922c-993c12dc3b53'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1171cf53-e384-4cf6-8e58-4e08d675475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c69fa38-1485-41bd-922c-993c12dc3b53', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079b1f0b-9d7f-48aa-9bc1-59d3edec4d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Volume volume-0c69fa38-1485-41bd-922c-993c12dc3b53 (0c69fa38-1485-41bd-922c-993c12dc3b53): created successfully Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079b1f0b-9d7f-48aa-9bc1-59d3edec4d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Flow 'volume_create_manager' (0335c22c-b551-4cc1-84b8-c7006c3e7f02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4bc773b1-9276-4a8d-9bbb-d87d786c9291 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Created volume successfully. Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342322176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.manager [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:07:15 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Deleted volume successfully. Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9b95f1d6-3edc-4454-99e1-08b6e3d0eb19 tempest-VolumesExtendTest-1766020092 None] Lock "cinder-14cd8007-5250-4639-a997-7437dda8a470-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] create export for volume: c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] ensure volume c7267b8e-f20c-4625-b82d-b1a31a337714 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] check if targe iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] create target and attach volume c7267b8e-f20c-4625-b82d-b1a31a337714 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] create target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] create export for volume: 0c69fa38-1485-41bd-922c-993c12dc3b53. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] ensure volume 0c69fa38-1485-41bd-922c-993c12dc3b53 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] check if targe iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] create target and attach volume 0c69fa38-1485-41bd-922c-993c12dc3b53 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] create target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] atach volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 to target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] atach volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 to target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3633343366346163', 'lun': 0, 'mode': 'wt', 'name': 'v_c7267b8e-f20c-4625-b82d-b1a31a337714', 'prod_id': 'Storage', 'scsi_id': '6343f4ac6684701b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] add credentails to target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:07:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Geting {'code': 201, 'error': None, 'data': {'name': 'xEjqaYiH'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] initialize_connection for c7267b8e-f20c-4625-b82d-b1a31a337714 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'd6d7170d-c0b7-44c2-8d8d-e660dfce2da1'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6536633238633438', 'lun': 0, 'mode': 'wt', 'name': 'v_0c69fa38-1485-41bd-922c-993c12dc3b53', 'prod_id': 'Storage', 'scsi_id': 'e6c28c483512a70e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] add credentails to target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:20 user cinder-volume[84560]: INFO cinder.volume.manager [req-6cc42e96-529e-445f-9410-16d761a7d8ef req-4d4b280d-1824-435a-a80c-64070020575f tempest-TestVolumeSwap-882310266 None] attachment_update completed successfully. Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 201, 'error': None, 'data': {'name': 'zaiQnIop'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] initialize_connection for 0c69fa38-1485-41bd-922c-993c12dc3b53 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:07:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zaiQnIop', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '4b3e18ed-6891-4d28-847a-0a42d48f6fce'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:07:20 user cinder-volume[84560]: INFO cinder.volume.manager [req-6c69183a-9b6c-45b0-baf2-1589e9e22ce4 req-37c92b54-4a21-4c87-869e-d3ba45433f08 tempest-AttachSCSIVolumeTestJSON-1907301903 None] attachment_update completed successfully. Apr 14 00:07:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Flow 'volume_create_manager' (55d6e5fe-264e-433f-928c-aed128f21e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965c9f53-23b2-4bf2-bcf2-4e72717ca380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965c9f53-23b2-4bf2-bcf2-4e72717ca380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3c8509e1-43e0-44b4-8100-9789966e0abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f05cc5ddc7494aa2b3af6d4266e6cf07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:07:22Z,use_quota=True,user_id='95c20481e8a044b9ad38e8aa8791d09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b02806e-7d46-484e-8dc0-85817a53dc73),volume_type_id=3b02806e-7d46-484e-8dc0-85817a53dc73)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c83ff0-ba3e-45ea-8e1a-3758ee78e272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0c83ff0-ba3e-45ea-8e1a-3758ee78e272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e8ed42-1d70-4d07-ba7b-add579d7c629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114342309888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e8ed42-1d70-4d07-ba7b-add579d7c629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3c8509e1-43e0-44b4-8100-9789966e0abe', 'volume_name': 'volume-3c8509e1-43e0-44b4-8100-9789966e0abe', 'volume_size': 1, 'image_id': '7ba03105-fa51-4761-8fea-4a301738c296', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6d0b640cfcb80958d90f0aff9440282', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f05cc5ddc7494aa2b3af6d4266e6cf07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd4c0e74d06116da07b8daa2b19df29e6b945fddb07e488133bb3c35c61df22af5da74b38efda4b41b0fee6f030730b2b1fea7fc2d8155895da068b2c6cfd20f', 'id': '7ba03105-fa51-4761-8fea-4a301738c296', 'created_at': datetime.datetime(2023, 4, 14, 0, 7, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 7, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ba03105-fa51-4761-8fea-4a301738c296/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7abb06-1f4e-4ff8-88c0-76305d83cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e7abb06-1f4e-4ff8-88c0-76305d83cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed40b4c6-f0b2-442e-95ff-6815017efe26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:22 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume 3c8509e1-43e0-44b4-8100-9789966e0abe: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3c8509e1-43e0-44b4-8100-9789966e0abe', 'volume_size': 1, 'image_id': '7ba03105-fa51-4761-8fea-4a301738c296', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6d0b640cfcb80958d90f0aff9440282', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f05cc5ddc7494aa2b3af6d4266e6cf07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd4c0e74d06116da07b8daa2b19df29e6b945fddb07e488133bb3c35c61df22af5da74b38efda4b41b0fee6f030730b2b1fea7fc2d8155895da068b2c6cfd20f', 'id': '7ba03105-fa51-4761-8fea-4a301738c296', 'created_at': datetime.datetime(2023, 4, 14, 0, 7, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 7, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ba03105-fa51-4761-8fea-4a301738c296/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Cloning 3c8509e1-43e0-44b4-8100-9789966e0abe from image 7ba03105-fa51-4761-8fea-4a301738c296 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Acquiring lock "cinder-7ba03105-fa51-4761-8fea-4a301738c296" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "cinder-7ba03105-fa51-4761-8fea-4a301738c296" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Preparing cache entry for image = 7ba03105-fa51-4761-8fea-4a301738c296 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:891}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Attempting to retrieve cache entry for image = 7ba03105-fa51-4761-8fea-4a301738c296 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:07:22 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2, size 0.00 MB, duration 1.00 sec {{(pid=84560) fetch /opt/stack/cinder/cinder/image/image_utils.py:628}} Apr 14 00:07:22 user cinder-volume[84560]: INFO cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Image download 0.00 MB at 0.00 MB/s Apr 14 00:07:22 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:22 user sudo[93812]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 Apr 14 00:07:22 user sudo[93812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:23 user sudo[93812]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:23 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2" returned: 0 in 0.866s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:23 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Temporary image 7ba03105-fa51-4761-8fea-4a301738c296 is fetched for user 95c20481e8a044b9ad38e8aa8791d09c. {{(pid=84560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1279}} Apr 14 00:07:23 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:23 user sudo[93851]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 Apr 14 00:07:23 user sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] create export for volume: 2024a461-c307-42e0-976a-bde8b1ef0bed. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:07:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] ensure volume 2024a461-c307-42e0-976a-bde8b1ef0bed assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:07:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] check if targe iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:07:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:24 user sudo[93851]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] create target and attach volume 2024a461-c307-42e0-976a-bde8b1ef0bed to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] create target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2" returned: 0 in 0.872s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] creating volume v_3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] create volume {'name': 'v_3c8509e1-43e0-44b4-8100-9789966e0abe', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3c8509e1-43e0-44b4-8100-9789966e0abe', 'is_clone': False, 'name': 'v_3c8509e1-43e0-44b4-8100-9789966e0abe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Attempting download of 7ba03105-fa51-4761-8fea-4a301738c296 ((None, None)) to volume 3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] copy_image_to_volume volume-3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) _copy_image_data_to_volume /opt/stack/cinder/cinder/volume/driver.py:890}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG os_brick.utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f7da7-1030-44e1-8f1c-1ff075b2ac67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4160002f-8f4f-4cb7-bc41-abc413f56b94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22cf080-643d-44af-a340-2cbd583e162e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a815c0-1ed1-493e-89ea-6aa94bace4d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): nvme version {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] 'nvme version' failed. Not Retrying. {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] nvme not present on system {{(pid=84560) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 00:07:25 user cinder-volume[84560]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 00:07:25 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdca26f-7c48-4fa0-b12a-d032f17fffeb]: (4, '') {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=84560) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=84560) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] LIGHTOS: no hostnqn found. {{(pid=84560) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG os_brick.utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume 3c8509e1-43e0-44b4-8100-9789966e0abe: creating export {{(pid=84560) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] create export for volume: 3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] ensure volume 3c8509e1-43e0-44b4-8100-9789966e0abe assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] check if targe iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] create target and attach volume 3c8509e1-43e0-44b4-8100-9789966e0abe to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] create target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] terminate connection for 0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:25 user cinder-volume[84560]: INFO cinder.volume.manager [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Terminate volume connection completed successfully. Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Deleting attachment 4b3e18ed-6891-4d28-847a-0a42d48f6fce. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] remove_export for volume: 0c69fa38-1485-41bd-922c-993c12dc3b53. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1024595318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0c69fa38-1485-41bd-922c-993c12dc3b53,launched_at=2023-04-14T00:07:15Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ccde4d67c2ed45af968e5f219cc8b6c2',provider_auth='CHAP zaiQnIop isuZqkJnQp2IoF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:14Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:07:25Z,use_quota=True,user_id='b3bff58a90484c5db3f035ab1187080e',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] detach volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 from target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] delete target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] delete target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-41e0a092-53e9-4094-8125-45e95d18e564 req-df1fe386-e0f8-4aa9-930f-18881f8d14f5 tempest-AttachSCSIVolumeTestJSON-1907301903 None] target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] create export for volume: 2509f860-ef4a-443f-9fc8-171e0df13a7a. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] ensure volume 2509f860-ef4a-443f-9fc8-171e0df13a7a assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] check if targe iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] create target and attach volume 2509f860-ef4a-443f-9fc8-171e0df13a7a to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] create target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] atach volume v_2024a461-c307-42e0-976a-bde8b1ef0bed to target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] atach volume v_3c8509e1-43e0-44b4-8100-9789966e0abe to target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3633383563333363', 'lun': 0, 'mode': 'wt', 'name': 'v_2024a461-c307-42e0-976a-bde8b1ef0bed', 'prod_id': 'Storage', 'scsi_id': '6385c33cb985ab7d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] add credentails to target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Geting {'code': 201, 'error': None, 'data': {'name': 'WjavJYiu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] initialize_connection for 2024a461-c307-42e0-976a-bde8b1ef0bed 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WjavJYiu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '74bac691-d1f6-43b8-a34c-bed108865e23'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:07:28 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=74,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:28 user cinder-volume[84560]: INFO cinder.volume.manager [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-4181ccb3-8a04-484f-9812-d3db6e1f0472 tempest-TestVolumeSwap-872962825 None] attachment_update completed successfully. Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3833623632326336', 'lun': 0, 'mode': 'wt', 'name': 'v_3c8509e1-43e0-44b4-8100-9789966e0abe', 'prod_id': 'Storage', 'scsi_id': '83b622c6f53a9ea0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] add credentails to target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 201, 'error': None, 'data': {'name': 'FfPryVvo'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] initialize_connection for 3c8509e1-43e0-44b4-8100-9789966e0abe 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connector [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Factory for iscsi on None {{(pid=84560) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfPryVvo', 'auth_password': '***', 'target_lun': False}}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:07:29 user cinder-volume[84560]: INFO os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[721fcc14-886e-44b3-8a13-9cf6fb07a8ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 00:07:29 user cinder-volume[84560]: {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --interface default --op new {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2132d-d9d7-4e74-8221-99e2e9df7e35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe] added\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe] added Apr 14 00:07:29 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac76c47-c1a5-429e-a360-704c49cb0249]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[686b04de-34b6-4a23-8c95-707f4b86ed16]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfPryVvo {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfPryVvo" returned: 0 in 0.017s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c8bf02-ddf7-43d1-973b-a2f07b140ec4]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfPryVvo'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[404d2b71-9447-4a6f-9bea-586ac8acde2b]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c655f18-7fc5-4f1f-a558-0218da963691]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --login {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f90808b-7284-4bbf-b211-f08e2a8a147c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260] Apr 14 00:07:29 user cinder-volume[84560]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260] successful. Apr 14 00:07:29 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8091e-acac-423c-9113-b1e8d342fa0c]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4b6226-ebd1-4eaa-b0ee-2db787a92bbd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash) Apr 14 00:07:29 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Connected to 172.16.0.220:3260 {{(pid=84560) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=84560) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Scanning host 36 c: -, t: -, l: 0) {{(pid=84560) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] atach volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a to target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9b8a50-f727-40ec-8acd-5de97bd5aec7]: (4, ('- - 0', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=84560) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 00:07:29 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfPryVvo', 'auth_password': '***', 'target_lun': False} {{(pid=84560) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23833623632326336', 'path': '/dev/sde'} {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sde of=/dev/null count=1 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sde of=/dev/null count=1" returned: 0 in 0.426s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b2ebe6-1bd5-4ed7-ab1d-e53fcd10c0f6]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.411504 s, 1.2 kB/s\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6637633937626537', 'lun': 0, 'mode': 'wt', 'name': 'v_2509f860-ef4a-443f-9fc8-171e0df13a7a', 'prod_id': 'Storage', 'scsi_id': 'f7c97be76e683cf6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] add credentails to target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_7ba03105-fa51-4761-8fea-4a301738c296_2ow6i1ne {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KIpsbQYd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] initialize_connection for 2509f860-ef4a-443f-9fc8-171e0df13a7a 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:07:31 user sudo[94287]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_7ba03105-fa51-4761-8fea-4a301738c296_2ow6i1ne Apr 14 00:07:31 user sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KIpsbQYd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0ed1c3f7-2d31-4247-873f-6c44d1a66f6f'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:07:31 user cinder-volume[84560]: INFO cinder.volume.manager [req-ad8d0773-6b84-4d51-8fc4-e9664f932131 req-c6439bb9-3961-45c1-a0b8-cc833b9d6aa9 tempest-TaggedAttachmentsTest-694590407 None] attachment_update completed successfully. Apr 14 00:07:32 user sudo[94287]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:32 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_download_7ba03105-fa51-4761-8fea-4a301738c296_2ow6i1ne" returned: 0 in 1.250s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:32 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:32 user sudo[94336]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 Apr 14 00:07:32 user sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:33 user sudo[94336]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:33 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2" returned: 0 in 1.122s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:33 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] 7ba03105-fa51-4761-8fea-4a301738c296 was raw, converting to raw {{(pid=84560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:976}} Apr 14 00:07:33 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 of=/dev/sde oflag=direct {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:33 user sudo[94346]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 of=/dev/sde oflag=direct Apr 14 00:07:33 user sudo[94346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:34 user sudo[94346]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:34 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf dd count=0 if=/opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 of=/dev/sde oflag=direct" returned: 0 in 0.974s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:34 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 /dev/sde {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:34 user sudo[94362]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 /dev/sde Apr 14 00:07:34 user sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] terminate connection for c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:35 user cinder-volume[84560]: INFO cinder.volume.manager [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Terminate volume connection completed successfully. Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Deleting attachment d6d7170d-c0b7-44c2-8d8d-e660dfce2da1. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] remove_export for volume: c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-150766836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c7267b8e-f20c-4625-b82d-b1a31a337714,launched_at=2023-04-14T00:05:14Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth='CHAP xEjqaYiH DC6FyeHmOsIU58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:12Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:07:23Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] detach volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 from target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=71,cinder:INSERT=3,cinder:UPDATE=26 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] delete target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] delete target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:35 user sudo[94362]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:35 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -t none -f raw /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 /dev/sde" returned: 0 in 0.800s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:35 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:35 user sudo[94402]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2 Apr 14 00:07:35 user sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0ea7fd0b-2c5e-4b3b-9956-7cba90dc8794 req-32280161-0a1d-45eb-830f-13a18e84aada tempest-TestVolumeSwap-872962825 None] target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:36 user sudo[94402]: pam_unix(sudo:session): session closed for user root Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info --output=json /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2" returned: 0 in 0.835s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7ba03105-fa51-4761-8fea-4a301738c296_s0luxl_nuser@joviandss-2, size 0.00 MB, duration 1.00 sec, destination /dev/sde {{(pid=84560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:432}} Apr 14 00:07:36 user cinder-volume[84560]: INFO cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Converted 0.00 MB image at 0.00 MB/s Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfPryVvo', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23833623632326336', 'path': '/dev/sde'}), 'kwargs': {'force': False}}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7734656-7ea6-4b73-a340-84b32cf6bb4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 00:07:36 user cinder-volume[84560]: No targets found. Apr 14 00:07:36 user cinder-volume[84560]: iSNS: Apr 14 00:07:36 user cinder-volume[84560]: No targets found. Apr 14 00:07:36 user cinder-volume[84560]: STATIC: Apr 14 00:07:36 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe Apr 14 00:07:36 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:07:36 user cinder-volume[84560]: Iface Name: default Apr 14 00:07:36 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 Apr 14 00:07:36 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:07:36 user cinder-volume[84560]: Iface Name: default Apr 14 00:07:36 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed Apr 14 00:07:36 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:07:36 user cinder-volume[84560]: Iface Name: default Apr 14 00:07:36 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a Apr 14 00:07:36 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:07:36 user cinder-volume[84560]: Iface Name: default Apr 14 00:07:36 user cinder-volume[84560]: FIRMWARE: Apr 14 00:07:36 user cinder-volume[84560]: No targets found. Apr 14 00:07:36 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 00:07:36 user cinder-volume[84560]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 00:07:36 user cinder-volume[84560]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=84560) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe', 0)] {{(pid=84560) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0747f6d0-5485-4271-bb11-3c856d6d355d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc56dcef-33c2-42ee-9d00-b59d1f7e7870]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a (non-flash) Apr 14 00:07:36 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Resulting device map defaultdict(. at 0x7fdcc7ddb910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe'): ({'sde'}, set())}) {{(pid=84560) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Removing single pathed devices sde {{(pid=84560) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ca10c-0f31-4d10-95f1-0634cf6ca632]: (4, ('path checker states:\nup 4\n\npaths: 0\nbusy: False\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398831c-b09a-43aa-89ae-9fe21c0faaa8]: (4, ('ok\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Flushing IO for device /dev/sde {{(pid=84560) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630c38b-be76-48d8-9d40-a1e4fa451095]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=84560) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657071d-1035-4c5b-a2fa-7d30c0787503]: (4, ('1', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Checking to see if SCSI volumes sde have been removed. {{(pid=84560) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] SCSI volumes sde have been removed. {{(pid=84560) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe')] {{(pid=84560) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7200fc98-010c-4900-9b42-d064b21a2e03]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --logout {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc09bc7-e338-43af-a226-299126d7302b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260] Apr 14 00:07:36 user cinder-volume[84560]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe, portal: 172.16.0.220,3260] successful. Apr 14 00:07:36 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op delete {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a4a23-d239-497f-b2fb-56a6ea2ca564]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] <== disconnect_volume: return (336ms) None {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] terminate connection for 3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] volume 3c8509e1-43e0-44b4-8100-9789966e0abe: removing export {{(pid=84560) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] remove_export for volume: 3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3c8509e1-43e0-44b4-8100-9789966e0abe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f05cc5ddc7494aa2b3af6d4266e6cf07',provider_auth='CHAP FfPryVvo H5WpVk079FiZr2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='downloading',terminated_at=None,updated_at=2023-04-14T00:07:22Z,use_quota=True,user_id='95c20481e8a044b9ad38e8aa8791d09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b02806e-7d46-484e-8dc0-85817a53dc73),volume_type_id=3b02806e-7d46-484e-8dc0-85817a53dc73) from target:iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] detach volume v_3c8509e1-43e0-44b4-8100-9789966e0abe from target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] terminate connection for 2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:37 user cinder-volume[84560]: INFO cinder.volume.manager [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Terminate volume connection completed successfully. Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Deleting attachment 0ed1c3f7-2d31-4247-873f-6c44d1a66f6f. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] remove_export for volume: 2509f860-ef4a-443f-9fc8-171e0df13a7a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1314603800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2509f860-ef4a-443f-9fc8-171e0df13a7a,launched_at=2023-04-14T00:05:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c4ee7b5626a14c69aefa86192b6e7bac',provider_auth='CHAP KIpsbQYd 50rOApFNLKSsdv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:23Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:07:36Z,use_quota=True,user_id='38f9a13bd3f74842b61b57b2ea8bf025',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] detach volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a from target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] delete target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] delete target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] delete target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] delete target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] create export for volume: c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] ensure volume c7267b8e-f20c-4625-b82d-b1a31a337714 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] check if targe iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] create target and attach volume c7267b8e-f20c-4625-b82d-b1a31a337714 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] create target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Downloaded image 7ba03105-fa51-4761-8fea-4a301738c296 ((None, None)) to volume 3c8509e1-43e0-44b4-8100-9789966e0abe successfully. {{(pid=84560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1232}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Temporary image 7ba03105-fa51-4761-8fea-4a301738c296 for user 95c20481e8a044b9ad38e8aa8791d09c is deleted. {{(pid=84560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1283}} Apr 14 00:07:37 user cinder-volume[84560]: WARNING cinder.quota [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:07:37 user cinder-volume[84560]: WARNING cinder.quota [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.quota [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Created reservations ['68f2e98e-3b37-4730-b493-dff94d81e8f8', '2324ea66-f81d-4d2b-8227-f8b4145ad2d8', '8d1169ba-c60b-46a9-b787-5147712c84bd', 'dbb8b1f7-2b38-4ef9-b3e8-61447b95bbfb'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Creating image volume entry: {'display_name': 'image-7ba03105-fa51-4761-8fea-4a301738c296', 'deleted': False, 'provider_location': '172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe 0', 'replication_driver_data': None, 'volume_type_id': '3b02806e-7d46-484e-8dc0-85817a53dc73', 'volume_metadata': [], 'size': 1, 'terminated_at': None, 'provider_id': None, 'launched_at': None, 'previous_status': None, 'user_id': '95c20481e8a044b9ad38e8aa8791d09c', 'host': 'user@joviandss-2#joviandss-2', 'availability_zone': 'nova', 'provider_auth': 'CHAP FfPryVvo H5WpVk079FiZr2', 'encryption_key_id': None, 'ec2_id': None, 'replication_status': None, 'replication_extended_status': None, 'service_uuid': None, 'provider_geometry': None, 'multiattach': False, 'display_description': None, 'consistencygroup_id': None, 'volume_admin_metadata': [], 'bootable': False, 'updated_at': datetime.datetime(2023, 4, 14, 0, 7, 22, tzinfo=datetime.timezone.utc), 'project_id': '1c8fe019fcbc488f9d8248e0eca402ee', 'group_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'created_at': datetime.datetime(2023, 4, 14, 0, 7, 22, tzinfo=datetime.timezone.utc), 'cluster_name': None, 'scheduled_at': datetime.datetime(2023, 4, 14, 0, 7, 22, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'shared_targets': True, 'metadata': {}, 'attach_status': 'detached', 'status': 'creating', 'source_volid': '3c8509e1-43e0-44b4-8100-9789966e0abe'}. {{(pid=84560) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1660}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume reschedule parameters: False retry: None {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Flow 'volume_create_manager' (14553599-6a2b-4d43-92a3-a923de25f7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e908b0b0-2bf9-4e66-9220-0dbd141d6d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e908b0b0-2bf9-4e66-9220-0dbd141d6d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='image-7ba03105-fa51-4761-8fea-4a301738c296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80e596ec-efcc-49c9-abc9-fbd748f42c97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8fe019fcbc488f9d8248e0eca402ee',provider_auth='CHAP FfPryVvo H5WpVk079FiZr2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3c8509e1-43e0-44b4-8100-9789966e0abe,status='creating',terminated_at=None,updated_at=2023-04-14T00:07:22Z,use_quota=True,user_id='95c20481e8a044b9ad38e8aa8791d09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b02806e-7d46-484e-8dc0-85817a53dc73),volume_type_id=3b02806e-7d46-484e-8dc0-85817a53dc73)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d285870-b6ff-4524-8fc8-f2435d2b26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d285870-b6ff-4524-8fc8-f2435d2b26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234ab15e-a576-428e-84a9-d7017d212137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234ab15e-a576-428e-84a9-d7017d212137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '80e596ec-efcc-49c9-abc9-fbd748f42c97', 'volume_name': 'volume-80e596ec-efcc-49c9-abc9-fbd748f42c97', 'volume_size': 1, 'source_volid': '3c8509e1-43e0-44b4-8100-9789966e0abe', 'source_volstatus': 'downloading'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e2e499-2e68-4499-b980-7f9043d7e08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e2e499-2e68-4499-b980-7f9043d7e08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a93bd1-66f5-440b-bbdf-0a6545ce02e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume 80e596ec-efcc-49c9-abc9-fbd748f42c97: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-80e596ec-efcc-49c9-abc9-fbd748f42c97', 'volume_size': 1, 'source_volid': '3c8509e1-43e0-44b4-8100-9789966e0abe', 'source_volstatus': 'downloading'} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] cloned volume 3c8509e1-43e0-44b4-8100-9789966e0abe to 80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] cloning v_3c8509e1-43e0-44b4-8100-9789966e0abe to v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] create snapshot v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-875e90a3-d7ec-4722-9566-3313c929882b req-d09cd487-b422-4274-a2a2-807794b9ffea tempest-TaggedAttachmentsTest-694590407 None] target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_80e596ec-efcc-49c9-abc9-fbd748f42c97'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] create volume v_80e596ec-efcc-49c9-abc9-fbd748f42c97 from snapshot v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3c8509e1-43e0-44b4-8100-9789966e0abe@v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'is_clone': True, 'full_name': 'Pool-0/v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'name': 'v_80e596ec-efcc-49c9-abc9-fbd748f42c97'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] get volume v_80e596ec-efcc-49c9-abc9-fbd748f42c97 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_3c8509e1-43e0-44b4-8100-9789966e0abe@v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432268', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '107942', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1732984156891448663', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eb41f85bf6af0f1d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342166528', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '78136', 'name': 'v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a93bd1-66f5-440b-bbdf-0a6545ce02e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80e596ec-efcc-49c9-abc9-fbd748f42c97', 'volume_size': 1, 'source_volid': '3c8509e1-43e0-44b4-8100-9789966e0abe', 'source_volstatus': 'downloading'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11cc872-a864-485d-a37e-4c9131e3614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume volume-80e596ec-efcc-49c9-abc9-fbd748f42c97 (80e596ec-efcc-49c9-abc9-fbd748f42c97): created successfully Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11cc872-a864-485d-a37e-4c9131e3614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Flow 'volume_create_manager' (14553599-6a2b-4d43-92a3-a923de25f7bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Created volume successfully. Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Creating new image-volume cache entry for image 7ba03105-fa51-4761-8fea-4a301738c296 on user@joviandss-2#joviandss-2 {{(pid=84560) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] New image-volume cache entry created: {'id': 2, 'image_id': '7ba03105-fa51-4761-8fea-4a301738c296', 'volume_id': '80e596ec-efcc-49c9-abc9-fbd748f42c97', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 7, 21), 'last_used': datetime.datetime(2023, 4, 14, 0, 7, 40, 98207)}. {{(pid=84560) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "cinder-7ba03105-fa51-4761-8fea-4a301738c296" released by "_prepare_image_cache_entry" :: held 18.036s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Marking volume 3c8509e1-43e0-44b4-8100-9789966e0abe as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Copying metadata from image 7ba03105-fa51-4761-8fea-4a301738c296 to 3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Creating volume glance metadata for volume 3c8509e1-43e0-44b4-8100-9789966e0abe backed by image 7ba03105-fa51-4761-8fea-4a301738c296 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7ba03105-fa51-4761-8fea-4a301738c296', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c6d0b640cfcb80958d90f0aff9440282', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed40b4c6-f0b2-442e-95ff-6815017efe26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c8509e1-43e0-44b4-8100-9789966e0abe', 'volume_size': 1, 'image_id': '7ba03105-fa51-4761-8fea-4a301738c296', 'image_location': (None, None), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c6d0b640cfcb80958d90f0aff9440282', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f05cc5ddc7494aa2b3af6d4266e6cf07', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd4c0e74d06116da07b8daa2b19df29e6b945fddb07e488133bb3c35c61df22af5da74b38efda4b41b0fee6f030730b2b1fea7fc2d8155895da068b2c6cfd20f', 'id': '7ba03105-fa51-4761-8fea-4a301738c296', 'created_at': datetime.datetime(2023, 4, 14, 0, 7, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 7, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7ba03105-fa51-4761-8fea-4a301738c296/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b9683f-4eb5-495d-9d10-11b858fe55fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Volume volume-3c8509e1-43e0-44b4-8100-9789966e0abe (3c8509e1-43e0-44b4-8100-9789966e0abe): created successfully Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8b9683f-4eb5-495d-9d10-11b858fe55fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Flow 'volume_create_manager' (55d6e5fe-264e-433f-928c-aed128f21e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1d776da1-2916-4933-8d58-673002b44976 tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Created volume successfully. Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] atach volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 to target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Acquiring lock "cinder-3c8509e1-43e0-44b4-8100-9789966e0abe-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "cinder-3c8509e1-43e0-44b4-8100-9789966e0abe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] remove_export for volume: 3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3c8509e1-43e0-44b4-8100-9789966e0abe,launched_at=2023-04-14T00:07:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f05cc5ddc7494aa2b3af6d4266e6cf07',provider_auth='CHAP FfPryVvo H5WpVk079FiZr2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:22Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:07:41Z,updated_at=2023-04-14T00:07:41Z,use_quota=True,user_id='95c20481e8a044b9ad38e8aa8791d09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b02806e-7d46-484e-8dc0-85817a53dc73),volume_type_id=3b02806e-7d46-484e-8dc0-85817a53dc73) from target:iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] detach volume v_3c8509e1-43e0-44b4-8100-9789966e0abe from target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe/luns/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] failed to remove resource iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe because of JDSS resource v_3c8509e1-43e0-44b4-8100-9789966e0abe DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] delete target: iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] delete target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] failed to remove resource iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe because of JDSS resource iqn.2010-10.org.openstack:3c8509e1-43e0-44b4-8100-9789966e0abe DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] deleating volume v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] get snapshots for volume v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:31:08', 'volsize': '1073741824', 'createtxg': '107941', 'guid': '1554862844202564312', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'objsetid': '78130', 'name': 'v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'defer_destroy': 'off', 'san:volume_id': '83b622c6f53a9ea09a6864c2baf7a4040ee1a8ce', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3633343366346163', 'lun': 0, 'mode': 'wt', 'name': 'v_c7267b8e-f20c-4625-b82d-b1a31a337714', 'prod_id': 'Storage', 'scsi_id': '6343f4ac6684701b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] add credentails to target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Geting {'code': 201, 'error': None, 'data': {'name': 'xEjqaYiH'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] initialize_connection for c7267b8e-f20c-4625-b82d-b1a31a337714 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:07:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xEjqaYiH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e332173a-e2e2-4550-9444-dcd931408615'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:07:42 user cinder-volume[84560]: INFO cinder.volume.manager [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-5f5a6711-6d7e-4d46-8985-9e259fa301c9 tempest-TestVolumeSwap-872962825 None] attachment_update completed successfully. Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] volume v_3c8509e1-43e0-44b4-8100-9789966e0abe updated {{(pid=84560) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=19,cinder:SELECT=68,cinder:INSERT=12,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.quota [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Created reservations ['16023a54-40c7-40a5-9d6d-e58df2a0c6ff', '0ed4cdd2-a504-40af-8a7b-127b767f8cc8', 'f96137d4-80f7-4757-9f4e-58e94ddef5a2', '515be7b7-0c5b-4cd5-863b-1d208308f094'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342129664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.manager [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:07:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Deleted volume successfully. Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-77d1f3f5-2553-4806-b661-2cbad1e3e35e tempest-VolumeAndVolumeTypeFromImageTest-553565637 None] Lock "cinder-3c8509e1-43e0-44b4-8100-9789966e0abe-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Acquiring lock "cinder-80e596ec-efcc-49c9-abc9-fbd748f42c97-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Lock "cinder-80e596ec-efcc-49c9-abc9-fbd748f42c97-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] remove_export for volume: 80e596ec-efcc-49c9-abc9-fbd748f42c97. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='True'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='image-7ba03105-fa51-4761-8fea-4a301738c296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=80e596ec-efcc-49c9-abc9-fbd748f42c97,launched_at=2023-04-14T00:07:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c8fe019fcbc488f9d8248e0eca402ee',provider_auth='CHAP irVDsadN FAhp0YifErRGcS',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:22Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3c8509e1-43e0-44b4-8100-9789966e0abe,status='deleting',terminated_at=2023-04-14T00:07:44Z,updated_at=2023-04-14T00:07:44Z,use_quota=True,user_id='95c20481e8a044b9ad38e8aa8791d09c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b02806e-7d46-484e-8dc0-85817a53dc73),volume_type_id=3b02806e-7d46-484e-8dc0-85817a53dc73) from target:iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] detach volume v_80e596ec-efcc-49c9-abc9-fbd748f42c97 from target iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97/luns/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97/luns/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97/luns/v_80e596ec-efcc-49c9-abc9-fbd748f42c97'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97/luns/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] failed to remove resource iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 because of JDSS resource v_80e596ec-efcc-49c9-abc9-fbd748f42c97 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] delete target: iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] delete target iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] failed to remove resource iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 because of JDSS resource iqn.2010-10.org.openstack:80e596ec-efcc-49c9-abc9-fbd748f42c97 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] deleating volume v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] get snapshots for volume v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] get volume v_80e596ec-efcc-49c9-abc9-fbd748f42c97 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_3c8509e1-43e0-44b4-8100-9789966e0abe@v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432268', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '107942', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1732984156891448663', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'eb41f85bf6af0f1d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342141952', 'san:volume_id': 'eb41f85bf6af0f1da9a88cfa1e377ef102eb84d6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '78136', 'name': 'v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '8192', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_80e596ec-efcc-49c9-abc9-fbd748f42c97 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] get snapshots for volume t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '61440', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:31:08', 'volsize': '1073741824', 'createtxg': '107941', 'guid': '1554862844202564312', 'compressratio': '4.87', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '61440', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '4.87', 'fscontext': 'none', 'clones': 'Pool-0/v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'objsetid': '78130', 'name': 'v_80e596ec-efcc-49c9-abc9-fbd748f42c97', 'defer_destroy': 'off', 'san:volume_id': '83b622c6f53a9ea09a6864c2baf7a4040ee1a8ce', 'mlslabel': 'none', 'logicalreferenced': '159744', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] get volume t_3c8509e1-43e0-44b4-8100-9789966e0abe info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_3c8509e1-43e0-44b4-8100-9789966e0abe', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432254', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '61440', 'sharesmb': None, 'createtxg': '107913', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1388925163463297947', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '159744', 'compressratio': '4.87', 'rootcontext': 'none', 'default_scsi_id': '83b622c6f53a9ea0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342129664', 'san:volume_id': '83b622c6f53a9ea09a6864c2baf7a4040ee1a8ce', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.87', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '61440', 'objsetid': '78115', 'name': 't_3c8509e1-43e0-44b4-8100-9789966e0abe', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '61440', 'logicalreferenced': '159744', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] delete volume:t_3c8509e1-43e0-44b4-8100-9789966e0abe recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_3c8509e1-43e0-44b4-8100-9789966e0abe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Lock "cinder-80e596ec-efcc-49c9-abc9-fbd748f42c97-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server [None req-33a99171-bcdc-45f3-ac13-c594c2143b42 tempest-VolumeAndVolumeTypeFromImageTest-1197681955 None] Exception during message handling: KeyError: 'errno' Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 00:07:46 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] terminate connection for 2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:48 user cinder-volume[84560]: INFO cinder.volume.manager [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Terminate volume connection completed successfully. Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Deleting attachment 74bac691-d1f6-43b8-a34c-bed108865e23. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] remove_export for volume: 2024a461-c307-42e0-976a-bde8b1ef0bed. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1546552654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2024a461-c307-42e0-976a-bde8b1ef0bed,launched_at=2023-04-14T00:05:17Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth='CHAP WjavJYiu cIWh4w5LDsd1NV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:07:37Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] detach volume v_2024a461-c307-42e0-976a-bde8b1ef0bed from target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] delete target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] delete target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-dca97c84-7a9e-4752-aa2e-147feefef2b1 req-4d290aef-4040-4fcb-87e8-a278ccebecd1 tempest-TestVolumeSwap-872962825 None] target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Acquiring lock "cinder-9751d47f-616e-4dc7-b5c5-910ddde3d0af-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Lock "cinder-9751d47f-616e-4dc7-b5c5-910ddde3d0af-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=66,cinder:INSERT=11,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] remove_export for volume: 9751d47f-616e-4dc7-b5c5-910ddde3d0af. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1209941562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9751d47f-616e-4dc7-b5c5-910ddde3d0af,launched_at=2023-04-14T00:06:45Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834d867e665a4671a901218d21fa8704',provider_auth='CHAP BRmkKrYn cIwyK0pY7QtNRZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:44Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:07:51Z,updated_at=2023-04-14T00:07:51Z,use_quota=True,user_id='457273b82bcb4fa6bbee81fdd9e0265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] detach volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af from target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af/luns/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] failed to remove resource iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af because of JDSS resource v_9751d47f-616e-4dc7-b5c5-910ddde3d0af DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] delete target: iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] delete target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] failed to remove resource iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af because of JDSS resource iqn.2010-10.org.openstack:9751d47f-616e-4dc7-b5c5-910ddde3d0af DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] deleating volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] get snapshots for volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] get volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432214', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107847', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16007811623038035060', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '90cc6be992e3ce73', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342129664', 'san:volume_id': '90cc6be992e3ce7358d44fc806cca0f1cd299417', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79070', 'name': 'v_9751d47f-616e-4dc7-b5c5-910ddde3d0af', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] delete volume:v_9751d47f-616e-4dc7-b5c5-910ddde3d0af recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] terminate connection for c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:07:51 user cinder-volume[84560]: INFO cinder.volume.manager [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Terminate volume connection completed successfully. Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Deleting attachment e332173a-e2e2-4550-9444-dcd931408615. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] remove_export for volume: c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-150766836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c7267b8e-f20c-4625-b82d-b1a31a337714,launched_at=2023-04-14T00:05:14Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth='CHAP xEjqaYiH DC6FyeHmOsIU58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:12Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:07:51Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] detach volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 from target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] delete target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] delete target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ea2e1591-959d-4a64-bee6-63c97cae3b5f req-16f6bea7-b1b0-4dae-b792-e9684be5dcc6 tempest-TestVolumeSwap-882310266 None] target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9751d47f-616e-4dc7-b5c5-910ddde3d0af {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] volume v_9751d47f-616e-4dc7-b5c5-910ddde3d0af deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.quota [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Created reservations ['f40a2d61-0135-4e66-8ad3-5d96b01acdbd', '6d89279e-8cc6-4811-a444-5136321eb91b', 'a2b6a5d5-08c0-4aa4-a7e4-3ee84fab660b', 'c70a990f-62d5-4e6a-aaac-cdfe330c0cb8'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342223872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.manager [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:07:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Deleted volume successfully. Apr 14 00:07:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8cf8faed-37aa-4c64-a661-dc69202e8ecd tempest-DeleteServersTestJSON-1615746799 None] Lock "cinder-9751d47f-616e-4dc7-b5c5-910ddde3d0af-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Flow 'volume_create_manager' (19640e6f-627f-4122-af45-a5199968f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af9ed77-500c-4025-9422-a44b70d11dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af9ed77-500c-4025-9422-a44b70d11dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1294893956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d58a4076-4b41-44ba-94a2-80a3f499cddc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f072d6b575417d9b584c527f345c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:07:59Z,use_quota=True,user_id='8839de4e3e3b495b80006390ddd285a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3a1af5-886f-4b57-bd63-53f8ca86ce13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3a1af5-886f-4b57-bd63-53f8ca86ce13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7789024-1736-4ccc-8af0-da593232506e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7789024-1736-4ccc-8af0-da593232506e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58a4076-4b41-44ba-94a2-80a3f499cddc', 'volume_name': 'volume-d58a4076-4b41-44ba-94a2-80a3f499cddc', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b156aeb-d930-4908-a236-17cc0be6cfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b156aeb-d930-4908-a236-17cc0be6cfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d05a86-60f4-4784-a72c-796ad9c9c3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:07:59 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Volume d58a4076-4b41-44ba-94a2-80a3f499cddc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58a4076-4b41-44ba-94a2-80a3f499cddc', 'volume_size': 1} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] creating volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] create volume {'name': 'v_d58a4076-4b41-44ba-94a2-80a3f499cddc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:07:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d58a4076-4b41-44ba-94a2-80a3f499cddc', 'is_clone': False, 'name': 'v_d58a4076-4b41-44ba-94a2-80a3f499cddc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7d05a86-60f4-4784-a72c-796ad9c9c3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58a4076-4b41-44ba-94a2-80a3f499cddc', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c652017-6718-4043-a1ee-be6175b2673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:00 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Volume volume-d58a4076-4b41-44ba-94a2-80a3f499cddc (d58a4076-4b41-44ba-94a2-80a3f499cddc): created successfully Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c652017-6718-4043-a1ee-be6175b2673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Flow 'volume_create_manager' (19640e6f-627f-4122-af45-a5199968f45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:00 user cinder-volume[84560]: INFO cinder.volume.manager [req-f319456a-e933-415a-8e39-5acf5a6b028b req-34ac055f-b175-437c-9344-f97af10aa847 tempest-VolumesSnapshotsTestJSON-170691329 None] Created volume successfully. Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] create snapshot 622f5760-de05-4ce8-b760-992e7e7806ce for volume d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] cloning v_d58a4076-4b41-44ba-94a2-80a3f499cddc to s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] create snapshot s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_622f5760-de05-4ce8-b760-992e7e7806ce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] create volume s_622f5760-de05-4ce8-b760-992e7e7806ce from snapshot s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:08:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d58a4076-4b41-44ba-94a2-80a3f499cddc@s_622f5760-de05-4ce8-b760-992e7e7806ce', 'is_clone': True, 'full_name': 'Pool-0/s_622f5760-de05-4ce8-b760-992e7e7806ce', 'name': 's_622f5760-de05-4ce8-b760-992e7e7806ce'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] volume s_622f5760-de05-4ce8-b760-992e7e7806ce properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:08:02 user cinder-volume[84560]: INFO cinder.volume.manager [req-191767a9-992f-490d-a4bf-02ee8778c699 req-90075280-43fd-4dde-be82-7a4fd04eadc9 tempest-VolumesSnapshotsTestJSON-170691329 None] Create snapshot completed successfully Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.coordination [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Acquiring lock "cinder-622f5760-de05-4ce8-b760-992e7e7806ce-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.coordination [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Lock "cinder-622f5760-de05-4ce8-b760-992e7e7806ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] deleating snapshot s_622f5760-de05-4ce8-b760-992e7e7806ce. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] get snapshots for volume s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] get volume s_622f5760-de05-4ce8-b760-992e7e7806ce info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d58a4076-4b41-44ba-94a2-80a3f499cddc@s_622f5760-de05-4ce8-b760-992e7e7806ce', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_622f5760-de05-4ce8-b760-992e7e7806ce', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432291', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107973', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15917648401160827390', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9d8ac04124eee3c8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342105088', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78431', 'name': 's_622f5760-de05-4ce8-b760-992e7e7806ce', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] delete snapshot s_622f5760-de05-4ce8-b760-992e7e7806ce of volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots/s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots/s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots/s_622f5760-de05-4ce8-b760-992e7e7806ce {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] snapshot s_622f5760-de05-4ce8-b760-992e7e7806ce deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.quota [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Created reservations ['83559335-2384-4946-862d-40c5097c2769', 'd62e23da-74f2-4a44-a230-cdfe17102ea7', '94c4c060-d831-4d11-8135-ecfcde933837', '97e1afa6-1d31-4d5b-a0c7-2d6e723bfcd6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:08:05 user cinder-volume[84560]: INFO cinder.volume.manager [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Delete snapshot completed successfully. Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.coordination [req-a9397d0d-b560-4207-816b-821385635259 req-518e5e88-99af-4f4c-a5fb-b843cd7f639e tempest-VolumesSnapshotsTestJSON-170691329 None] Lock "cinder-622f5760-de05-4ce8-b760-992e7e7806ce-delete_snapshot" released by "delete_snapshot" :: held 2.132s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.coordination [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Acquiring lock "cinder-d58a4076-4b41-44ba-94a2-80a3f499cddc-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.coordination [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Lock "cinder-d58a4076-4b41-44ba-94a2-80a3f499cddc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] remove_export for volume: d58a4076-4b41-44ba-94a2-80a3f499cddc. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1294893956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d58a4076-4b41-44ba-94a2-80a3f499cddc,launched_at=2023-04-14T00:08:00Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64f072d6b575417d9b584c527f345c9e',provider_auth='CHAP JHBfLGqi SJLtl6HQDO9Bw1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:59Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:08:05Z,updated_at=2023-04-14T00:08:05Z,use_quota=True,user_id='8839de4e3e3b495b80006390ddd285a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] detach volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc from target iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc/luns/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc/luns/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc/luns/v_d58a4076-4b41-44ba-94a2-80a3f499cddc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc/luns/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] failed to remove resource iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc because of JDSS resource v_d58a4076-4b41-44ba-94a2-80a3f499cddc DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] delete target: iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] delete target iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] failed to remove resource iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc because of JDSS resource iqn.2010-10.org.openstack:d58a4076-4b41-44ba-94a2-80a3f499cddc DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] deleating volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] get snapshots for volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] get volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d58a4076-4b41-44ba-94a2-80a3f499cddc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432289', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107967', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6829261719045346517', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '656eb95d76bc202b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342117376', 'san:volume_id': '656eb95d76bc202b3e9bd61967de9333456f2fc9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78418', 'name': 'v_d58a4076-4b41-44ba-94a2-80a3f499cddc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] delete volume:v_d58a4076-4b41-44ba-94a2-80a3f499cddc recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d58a4076-4b41-44ba-94a2-80a3f499cddc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] volume v_d58a4076-4b41-44ba-94a2-80a3f499cddc deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.quota [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Created reservations ['7cc1f09b-6aae-4e4e-ac3b-16389679320e', '339e8a40-ad9f-4517-869f-86c19048cf34', '1026303d-e83d-4863-a21d-2047816c0203', '1ac7f4c2-0dc5-47d4-8dae-497390cd000a'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342199296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.manager [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:08:07 user cinder-volume[84560]: INFO cinder.volume.manager [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Deleted volume successfully. Apr 14 00:08:07 user cinder-volume[84560]: DEBUG cinder.coordination [req-741b3fbd-8f1a-4591-b6c2-4a4b10f11e83 req-3f417985-e8bc-48d4-be60-cd57cd662905 tempest-VolumesSnapshotsTestJSON-170691329 None] Lock "cinder-d58a4076-4b41-44ba-94a2-80a3f499cddc-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=32,cinder:SELECT=56,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Flow 'volume_create_manager' (db7a5d1a-bc8c-43d0-a3b3-081f57c2f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c1316e-a94b-4064-9c72-f221c47b625d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c1316e-a94b-4064-9c72-f221c47b625d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-598956334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ce6d0dc2-6060-415f-accb-e115c4d9413f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686b5fef50e149a389fe133bd1f2a4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:08:15Z,use_quota=True,user_id='77782abdbc5141b4ad67a8f33cc53eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fdea5b-3d82-426e-9439-0930fb0eaa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59fdea5b-3d82-426e-9439-0930fb0eaa75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28844d0a-5d58-4131-b1f4-d05d8c9720a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28844d0a-5d58-4131-b1f4-d05d8c9720a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce6d0dc2-6060-415f-accb-e115c4d9413f', 'volume_name': 'volume-ce6d0dc2-6060-415f-accb-e115c4d9413f', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f37d62-632e-472d-9f46-1d8cb85153d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0f37d62-632e-472d-9f46-1d8cb85153d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747b6d7d-d300-4e72-8bcb-1a2cf55712e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:15 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Volume ce6d0dc2-6060-415f-accb-e115c4d9413f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce6d0dc2-6060-415f-accb-e115c4d9413f', 'volume_size': 1} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] creating volume v_ce6d0dc2-6060-415f-accb-e115c4d9413f. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] create volume {'name': 'v_ce6d0dc2-6060-415f-accb-e115c4d9413f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] create export for volume: 8e63ed78-ec07-4e8f-8ec4-e81494a415a3. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] ensure volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] check if targe iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] create target and attach volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] create target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ce6d0dc2-6060-415f-accb-e115c4d9413f', 'is_clone': False, 'name': 'v_ce6d0dc2-6060-415f-accb-e115c4d9413f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (747b6d7d-d300-4e72-8bcb-1a2cf55712e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce6d0dc2-6060-415f-accb-e115c4d9413f', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af22e6e-ff6b-44f8-aacb-6b777d68e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Volume volume-ce6d0dc2-6060-415f-accb-e115c4d9413f (ce6d0dc2-6060-415f-accb-e115c4d9413f): created successfully Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1af22e6e-ff6b-44f8-aacb-6b777d68e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Flow 'volume_create_manager' (db7a5d1a-bc8c-43d0-a3b3-081f57c2f355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3691cbe1-912d-47f0-a092-1b98cedba36b tempest-VolumesServicesTestJSON-1419472447 None] Created volume successfully. Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Acquiring lock "cinder-ce6d0dc2-6060-415f-accb-e115c4d9413f-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Lock "cinder-ce6d0dc2-6060-415f-accb-e115c4d9413f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] remove_export for volume: ce6d0dc2-6060-415f-accb-e115c4d9413f. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-598956334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ce6d0dc2-6060-415f-accb-e115c4d9413f,launched_at=2023-04-14T00:08:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='686b5fef50e149a389fe133bd1f2a4fa',provider_auth='CHAP fhpNEPgz lW9yHBrG5zZJTn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:08:17Z,updated_at=2023-04-14T00:08:17Z,use_quota=True,user_id='77782abdbc5141b4ad67a8f33cc53eb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] detach volume v_ce6d0dc2-6060-415f-accb-e115c4d9413f from target iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f/luns/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f/luns/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f/luns/v_ce6d0dc2-6060-415f-accb-e115c4d9413f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f/luns/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] failed to remove resource iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f because of JDSS resource v_ce6d0dc2-6060-415f-accb-e115c4d9413f DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] delete target: iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] delete target iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] failed to remove resource iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f because of JDSS resource iqn.2010-10.org.openstack:ce6d0dc2-6060-415f-accb-e115c4d9413f DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] deleating volume v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] get snapshots for volume v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] get volume v_ce6d0dc2-6060-415f-accb-e115c4d9413f info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ce6d0dc2-6060-415f-accb-e115c4d9413f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432305', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107983', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5442705382040504008', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '876b3003aa131942', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342117376', 'san:volume_id': '876b3003aa131942e46f8a7b313f74443ba2113b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79126', 'name': 'v_ce6d0dc2-6060-415f-accb-e115c4d9413f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] delete volume:v_ce6d0dc2-6060-415f-accb-e115c4d9413f recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ce6d0dc2-6060-415f-accb-e115c4d9413f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] volume v_ce6d0dc2-6060-415f-accb-e115c4d9413f deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=62,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.quota [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Created reservations ['2e7daa0e-37c4-4ff1-a0d1-2eedf24287fc', '60976012-20ec-4fc0-936c-387f894f375a', '026618f9-c88b-44e8-a592-d4341572bee9', '18955c3e-4cd3-45a1-b63d-c12ce5d69cfd'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] atach volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 to target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Acquiring lock "cinder-0c69fa38-1485-41bd-922c-993c12dc3b53-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Lock "cinder-0c69fa38-1485-41bd-922c-993c12dc3b53-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] remove_export for volume: 0c69fa38-1485-41bd-922c-993c12dc3b53. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1024595318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0c69fa38-1485-41bd-922c-993c12dc3b53,launched_at=2023-04-14T00:07:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccde4d67c2ed45af968e5f219cc8b6c2',provider_auth='CHAP zaiQnIop isuZqkJnQp2IoF',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:07:14Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:08:19Z,updated_at=2023-04-14T00:08:19Z,use_quota=True,user_id='b3bff58a90484c5db3f035ab1187080e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] detach volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 from target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53/luns/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] failed to remove resource iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 because of JDSS resource v_0c69fa38-1485-41bd-922c-993c12dc3b53 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] delete target: iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] delete target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] failed to remove resource iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 because of JDSS resource iqn.2010-10.org.openstack:0c69fa38-1485-41bd-922c-993c12dc3b53 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] deleating volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] get snapshots for volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342199296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.manager [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:08:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Deleted volume successfully. Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1286890b-e442-4a13-8caa-0057fcf5aa1d tempest-VolumesServicesTestJSON-1419472447 None] Lock "cinder-ce6d0dc2-6060-415f-accb-e115c4d9413f-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] get volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0c69fa38-1485-41bd-922c-993c12dc3b53', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432244', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107901', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4493573419050796455', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e6c28c483512a70e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114342199296', 'san:volume_id': 'e6c28c483512a70e7465a49b5f9b536c8bfddaa1', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79281', 'name': 'v_0c69fa38-1485-41bd-922c-993c12dc3b53', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] delete volume:v_0c69fa38-1485-41bd-922c-993c12dc3b53 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3739613139643865', 'lun': 0, 'mode': 'wt', 'name': 'v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'prod_id': 'Storage', 'scsi_id': '79a19d8ee4148d5f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] add credentails to target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'name': 'GtexvRgE'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] initialize_connection for 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:08:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GtexvRgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '70533a79-9e86-4fea-9e41-237c588cdfb8'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:08:20 user cinder-volume[84560]: INFO cinder.volume.manager [req-c5e572d1-e002-4beb-a395-a1201bc92489 req-8625fce0-c60a-4964-8dc4-93f47b730b8f tempest-TestStampPattern-1381824337 None] attachment_update completed successfully. Apr 14 00:08:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c69fa38-1485-41bd-922c-993c12dc3b53 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] volume v_0c69fa38-1485-41bd-922c-993c12dc3b53 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.quota [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Created reservations ['b03b87c1-47c9-4122-86e1-a7d6e98958c6', '6c590534-1974-407e-8007-012a137b9b41', 'd68fbb26-f676-4ca7-9d9b-9b15319559fc', '0cbf290a-56f1-4f40-b12c-ecd0dbf09691'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342199296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:08:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Deleted volume successfully. Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06551374-3f00-448a-98e4-a0cca534e639 tempest-AttachSCSIVolumeTestJSON-1907301903 None] Lock "cinder-0c69fa38-1485-41bd-922c-993c12dc3b53-delete_volume" released by "delete_volume" :: held 2.455s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114342293504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:08:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] terminate connection for 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:08:26 user cinder-volume[84560]: INFO cinder.volume.manager [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Terminate volume connection completed successfully. Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Deleting attachment 70533a79-9e86-4fea-9e41-237c588cdfb8. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] remove_export for volume: 8e63ed78-ec07-4e8f-8ec4-e81494a415a3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-498124488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e63ed78-ec07-4e8f-8ec4-e81494a415a3,launched_at=2023-04-14T00:06:21Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='1f138770c7b4407d83c449500fc000a5',provider_auth='CHAP GtexvRgE mPnoeECLQSkrYD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:20Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:08:25Z,use_quota=True,user_id='6fe75acb64a94a2a88d370f43fa6b776',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] detach volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 from target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] delete target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] delete target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3bf613d5-8cd8-41fd-a78b-179a5d948a97 req-840eb4ad-cbc6-44db-a190-c4cef0b0a6eb tempest-TestStampPattern-1381824337 None] target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Flow 'volume_create_manager' (965ef360-6c98-4d29-ba09-c20f54302cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b13493-bf47-4e98-bf75-2468764c7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b13493-bf47-4e98-bf75-2468764c7a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-811798238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=028eff5c-aa61-4243-985e-5210aedff04a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c931198e56de4cf08db59bcc40f2a260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:08:40Z,use_quota=True,user_id='97374cd3cdc448cd8710561d44756ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159fb517-343f-4f80-9bbb-f9f81a6b8422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (159fb517-343f-4f80-9bbb-f9f81a6b8422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b889950e-e148-44f4-9bfe-6129317e425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b889950e-e148-44f4-9bfe-6129317e425a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028eff5c-aa61-4243-985e-5210aedff04a', 'volume_name': 'volume-028eff5c-aa61-4243-985e-5210aedff04a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcf3bd4-b448-4d41-a1ee-1229c8d06630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fcf3bd4-b448-4d41-a1ee-1229c8d06630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6d3d7c-28df-484a-b44e-b0c15496ecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Volume 028eff5c-aa61-4243-985e-5210aedff04a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028eff5c-aa61-4243-985e-5210aedff04a', 'volume_size': 1} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] creating volume v_028eff5c-aa61-4243-985e-5210aedff04a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] create volume {'name': 'v_028eff5c-aa61-4243-985e-5210aedff04a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_028eff5c-aa61-4243-985e-5210aedff04a', 'is_clone': False, 'name': 'v_028eff5c-aa61-4243-985e-5210aedff04a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6d3d7c-28df-484a-b44e-b0c15496ecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028eff5c-aa61-4243-985e-5210aedff04a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f968bdf-14b4-458c-a795-359a845a26fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:41 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Volume volume-028eff5c-aa61-4243-985e-5210aedff04a (028eff5c-aa61-4243-985e-5210aedff04a): created successfully Apr 14 00:08:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f968bdf-14b4-458c-a795-359a845a26fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Flow 'volume_create_manager' (965ef360-6c98-4d29-ba09-c20f54302cd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1f1edda2-bf35-489c-8db0-2ce301f1eb8a tempest-ServerStableDeviceRescueTest-481368698 None] Created volume successfully. Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] create export for volume: 028eff5c-aa61-4243-985e-5210aedff04a. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] ensure volume 028eff5c-aa61-4243-985e-5210aedff04a assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] check if targe iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] create target and attach volume 028eff5c-aa61-4243-985e-5210aedff04a to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] create target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Flow 'volume_create_manager' (334d6eaa-bfa3-416a-bf29-acc0c2dd040d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c746332a-779c-4e70-92f5-9a4d414443c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c746332a-779c-4e70-92f5-9a4d414443c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:44Z,deleted=False,deleted_at=None,display_description='',display_name='17c6c147-fb62-4204-a416-792b94d3f7dd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c3cfdf84-a3e1-41e3-85ec-481f5ba478cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3f111e24414976beddba7ef90c4793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:08:45Z,use_quota=True,user_id='90bad96535c3453792982c5acab9dbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cccbb27-5466-4440-8b2a-f7d214df7769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cccbb27-5466-4440-8b2a-f7d214df7769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fd5c4c-3c90-4e8c-8a50-900371b7df69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4fd5c4c-3c90-4e8c-8a50-900371b7df69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'volume_name': 'volume-c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a206ac-11bc-428a-bc9d-628b0b1ff3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a206ac-11bc-428a-bc9d-628b0b1ff3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e26d79a-4b3a-4608-a384-968f1baf6369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:44 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Volume c3cfdf84-a3e1-41e3-85ec-481f5ba478cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'volume_size': 1} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] creating volume v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create volume {'name': 'v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'is_clone': False, 'name': 'v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=50,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e26d79a-4b3a-4608-a384-968f1baf6369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16f49a-a798-467c-8541-93c82c382921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:45 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Volume volume-c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (c3cfdf84-a3e1-41e3-85ec-481f5ba478cc): created successfully Apr 14 00:08:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d16f49a-a798-467c-8541-93c82c382921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Flow 'volume_create_manager' (334d6eaa-bfa3-416a-bf29-acc0c2dd040d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:45 user cinder-volume[84560]: INFO cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-6ddfb714-7f2e-4698-bdaf-cfcbea8f676e tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Created volume successfully. Apr 14 00:08:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] atach volume v_028eff5c-aa61-4243-985e-5210aedff04a to target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:08:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3931393631306436', 'lun': 0, 'mode': 'wt', 'name': 'v_028eff5c-aa61-4243-985e-5210aedff04a', 'prod_id': 'Storage', 'scsi_id': '919610d61be62a32'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] add credentails to target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 201, 'error': None, 'data': {'name': 'iVbjylRT'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] initialize_connection for 028eff5c-aa61-4243-985e-5210aedff04a 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:08:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iVbjylRT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '679e00ff-1e9f-4d7a-83d1-85056920732d'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:08:47 user cinder-volume[84560]: INFO cinder.volume.manager [req-761516d5-28e7-4f2d-b183-22f0470c6fbf req-242b8a97-66ed-4dfc-ae10-5fdcc2d28a46 tempest-ServerStableDeviceRescueTest-481368698 None] attachment_update completed successfully. Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] create export for volume: af1b05d2-717a-489c-8bdf-160d00ebd122. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] ensure volume af1b05d2-717a-489c-8bdf-160d00ebd122 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] check if targe iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] create target and attach volume af1b05d2-717a-489c-8bdf-160d00ebd122 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] create target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=27,cinder:SELECT=56,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Flow 'volume_create_manager' (31bd859e-f430-46f6-9847-b0ede0177403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfb9ed0-938f-4c53-9816-b68e4febc09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfb9ed0-938f-4c53-9816-b68e4febc09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-427589178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49172d5a-2944-486a-a080-04548e55ac0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:08:49Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0ac0f7-4134-4841-8b6d-10765f56f1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea0ac0f7-4134-4841-8b6d-10765f56f1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082c2f7d-fe21-4d44-b154-1e315ec5a18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082c2f7d-fe21-4d44-b154-1e315ec5a18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49172d5a-2944-486a-a080-04548e55ac0d', 'volume_name': 'volume-49172d5a-2944-486a-a080-04548e55ac0d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e24d166-3e25-493b-88c0-aa474be9cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e24d166-3e25-493b-88c0-aa474be9cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5b16c3-cf25-42f0-9ccf-7debfdce2048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:48 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Volume 49172d5a-2944-486a-a080-04548e55ac0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49172d5a-2944-486a-a080-04548e55ac0d', 'volume_size': 1} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] creating volume v_49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] create volume {'name': 'v_49172d5a-2944-486a-a080-04548e55ac0d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_49172d5a-2944-486a-a080-04548e55ac0d', 'is_clone': False, 'name': 'v_49172d5a-2944-486a-a080-04548e55ac0d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b5b16c3-cf25-42f0-9ccf-7debfdce2048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49172d5a-2944-486a-a080-04548e55ac0d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d36cc0a-cd48-48d9-a4dd-0bb0f74e470c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:08:49 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Volume volume-49172d5a-2944-486a-a080-04548e55ac0d (49172d5a-2944-486a-a080-04548e55ac0d): created successfully Apr 14 00:08:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d36cc0a-cd48-48d9-a4dd-0bb0f74e470c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:08:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Flow 'volume_create_manager' (31bd859e-f430-46f6-9847-b0ede0177403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:08:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c1b0b2fc-8952-4639-80a7-8714afbe37ba tempest-ServerActionsTestJSON-948553482 None] Created volume successfully. Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create export for volume: c3cfdf84-a3e1-41e3-85ec-481f5ba478cc. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] ensure volume c3cfdf84-a3e1-41e3-85ec-481f5ba478cc assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] check if targe iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create target and attach volume c3cfdf84-a3e1-41e3-85ec-481f5ba478cc to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] create export for volume: 49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] ensure volume 49172d5a-2944-486a-a080-04548e55ac0d assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 49172d5a-2944-486a-a080-04548e55ac0d to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] atach volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 to target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] atach volume v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc to target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3463353866343366', 'lun': 0, 'mode': 'wt', 'name': 'v_af1b05d2-717a-489c-8bdf-160d00ebd122', 'prod_id': 'Storage', 'scsi_id': '4c58f43f2bc5fa7b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] add credentails to target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 201, 'error': None, 'data': {'name': 'dekLAOnU'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] initialize_connection for af1b05d2-717a-489c-8bdf-160d00ebd122 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:08:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dekLAOnU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '355a8c10-71ab-4aed-9e38-b43ec2211c2a'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:08:53 user cinder-volume[84560]: INFO cinder.volume.manager [req-d12139f0-59c1-4a14-9b35-f9a245039363 req-05ce614f-b653-4cd5-923f-323dd36fb12f tempest-AttachVolumeShelveTestJSON-1395403129 None] attachment_update completed successfully. Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] atach volume v_49172d5a-2944-486a-a080-04548e55ac0d to target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3630323661303463', 'lun': 0, 'mode': 'wt', 'name': 'v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'prod_id': 'Storage', 'scsi_id': '6026a04c4e320a03'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] add credentails to target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DXAVYghe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] initialize_connection for c3cfdf84-a3e1-41e3-85ec-481f5ba478cc 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:08:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DXAVYghe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'c83af900-31a1-488d-a8b4-ff896990a329'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:08:54 user cinder-volume[84560]: INFO cinder.volume.manager [req-8c92becd-7702-4bfb-a692-9be50476eee6 req-481631e5-83cc-4f39-87d1-f629a21bc439 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] attachment_update completed successfully. Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3735346365396464', 'lun': 0, 'mode': 'wt', 'name': 'v_49172d5a-2944-486a-a080-04548e55ac0d', 'prod_id': 'Storage', 'scsi_id': '754ce9dd2476b9b3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mpSjLhaD'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 49172d5a-2944-486a-a080-04548e55ac0d 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:08:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9dba4460-e1ac-4b84-94e0-f27800eb6e2f'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:08:55 user cinder-volume[84560]: INFO cinder.volume.manager [req-a604361f-16ab-4d0a-b00e-c4c6ec156a7d req-940c58bc-04c2-4f75-9bf1-e6e901f6a41f tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] terminate connection for 49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:09:05 user cinder-volume[84560]: INFO cinder.volume.manager [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Deleting attachment 9dba4460-e1ac-4b84-94e0-f27800eb6e2f. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-427589178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49172d5a-2944-486a-a080-04548e55ac0d,launched_at=2023-04-14T00:08:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP mpSjLhaD kHcvwSOuQGKYJI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:09:01Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] detach volume v_49172d5a-2944-486a-a080-04548e55ac0d from target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-1fcfca09-60ef-49d4-bbee-cfb6d2bda52d tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] create export for volume: 49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] ensure volume 49172d5a-2944-486a-a080-04548e55ac0d assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 49172d5a-2944-486a-a080-04548e55ac0d to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] atach volume v_49172d5a-2944-486a-a080-04548e55ac0d to target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:09:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3735346365396464', 'lun': 0, 'mode': 'wt', 'name': 'v_49172d5a-2944-486a-a080-04548e55ac0d', 'prod_id': 'Storage', 'scsi_id': '754ce9dd2476b9b3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'mpSjLhaD'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 49172d5a-2944-486a-a080-04548e55ac0d 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:09:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mpSjLhaD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a341bb68-6a2f-4266-9e1c-92874d4bb63a'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:09:12 user cinder-volume[84560]: INFO cinder.volume.manager [req-cd0f530f-a2ad-467a-b4a2-cdb165bf52d0 req-f8162362-9ec7-4475-b987-f1a9112a5e84 tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Flow 'volume_create_manager' (a4c97d13-5130-47da-bba2-9ea2907de1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027ce263-6d6b-4797-812c-c28d8f82ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (027ce263-6d6b-4797-812c-c28d8f82ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1511182728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=43ba2057-0822-4741-b91d-718067f21593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:09:13Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6903875-14c4-44dc-b279-6ad7dbdb7fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6903875-14c4-44dc-b279-6ad7dbdb7fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9090c24b-5df6-43f5-bea2-8441a9ac0b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9090c24b-5df6-43f5-bea2-8441a9ac0b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43ba2057-0822-4741-b91d-718067f21593', 'volume_name': 'volume-43ba2057-0822-4741-b91d-718067f21593', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b5c042-649d-4afe-88ae-1f465e1279b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b5c042-649d-4afe-88ae-1f465e1279b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e53a38-0f6f-4549-81a4-ee88ab0a6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:12 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Volume 43ba2057-0822-4741-b91d-718067f21593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43ba2057-0822-4741-b91d-718067f21593', 'volume_size': 1} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] creating volume v_43ba2057-0822-4741-b91d-718067f21593. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] create volume {'name': 'v_43ba2057-0822-4741-b91d-718067f21593', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_43ba2057-0822-4741-b91d-718067f21593', 'is_clone': False, 'name': 'v_43ba2057-0822-4741-b91d-718067f21593'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e53a38-0f6f-4549-81a4-ee88ab0a6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43ba2057-0822-4741-b91d-718067f21593', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd258404-f078-4098-bdb4-471040a454cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:13 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Volume volume-43ba2057-0822-4741-b91d-718067f21593 (43ba2057-0822-4741-b91d-718067f21593): created successfully Apr 14 00:09:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd258404-f078-4098-bdb4-471040a454cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Flow 'volume_create_manager' (a4c97d13-5130-47da-bba2-9ea2907de1b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5ba9261d-57f2-4f54-be23-4f3fad37c6f9 tempest-AttachVolumeNegativeTest-719597397 None] Created volume successfully. Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] create snapshot 9f451298-7f42-4338-8b9f-45b9729f491e for volume 8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] cloning v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 to s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] create snapshot s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] create export for volume: 43ba2057-0822-4741-b91d-718067f21593. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] ensure volume 43ba2057-0822-4741-b91d-718067f21593 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] check if targe iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] create target and attach volume 43ba2057-0822-4741-b91d-718067f21593 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] create target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_9f451298-7f42-4338-8b9f-45b9729f491e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] create volume s_9f451298-7f42-4338-8b9f-45b9729f491e from snapshot s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:09:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3@s_9f451298-7f42-4338-8b9f-45b9729f491e', 'is_clone': True, 'full_name': 'Pool-0/s_9f451298-7f42-4338-8b9f-45b9729f491e', 'name': 's_9f451298-7f42-4338-8b9f-45b9729f491e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] volume s_9f451298-7f42-4338-8b9f-45b9729f491e properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:09:17 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=15,cinder:DELETE=2,cinder:SELECT=76 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:17 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d8c02330-864c-4973-a820-0ed5760d0d94 tempest-TestStampPattern-1381824337 None] Create snapshot completed successfully Apr 14 00:09:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] atach volume v_43ba2057-0822-4741-b91d-718067f21593 to target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:09:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6534653234326266', 'lun': 0, 'mode': 'wt', 'name': 'v_43ba2057-0822-4741-b91d-718067f21593', 'prod_id': 'Storage', 'scsi_id': 'e4e242bfbbbca449'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] add credentails to target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'name': 'dNQGcVbh'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=64,cinder:DELETE=2,cinder:UPDATE=15 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] initialize_connection for 43ba2057-0822-4741-b91d-718067f21593 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:09:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNQGcVbh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '68c09242-06d5-4c79-9e23-2274dceabfd1'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:09:20 user cinder-volume[84560]: INFO cinder.volume.manager [req-77635fd0-cb0d-4400-9dd3-37360f9cbdfb req-6b531668-fddd-475f-85f3-4b883fe425cf tempest-AttachVolumeNegativeTest-719597397 None] attachment_update completed successfully. Apr 14 00:09:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:09:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:09:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:09:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114341801984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:09:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Acquiring lock "cinder-2509f860-ef4a-443f-9fc8-171e0df13a7a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Lock "cinder-2509f860-ef4a-443f-9fc8-171e0df13a7a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] remove_export for volume: 2509f860-ef4a-443f-9fc8-171e0df13a7a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1314603800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2509f860-ef4a-443f-9fc8-171e0df13a7a,launched_at=2023-04-14T00:05:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4ee7b5626a14c69aefa86192b6e7bac',provider_auth='CHAP KIpsbQYd 50rOApFNLKSsdv',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:23Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:09:23Z,updated_at=2023-04-14T00:09:23Z,use_quota=True,user_id='38f9a13bd3f74842b61b57b2ea8bf025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] detach volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a from target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a/luns/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] failed to remove resource iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a because of JDSS resource v_2509f860-ef4a-443f-9fc8-171e0df13a7a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] delete target: iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] delete target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] failed to remove resource iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a because of JDSS resource iqn.2010-10.org.openstack:2509f860-ef4a-443f-9fc8-171e0df13a7a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] deleating volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] get snapshots for volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] get volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2509f860-ef4a-443f-9fc8-171e0df13a7a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432133', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107721', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '601700353453146678', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f7c97be76e683cf6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341801984', 'san:volume_id': 'f7c97be76e683cf620fd918384abc1c5b2ea1fca', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78611', 'name': 'v_2509f860-ef4a-443f-9fc8-171e0df13a7a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] delete volume:v_2509f860-ef4a-443f-9fc8-171e0df13a7a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2509f860-ef4a-443f-9fc8-171e0df13a7a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] volume v_2509f860-ef4a-443f-9fc8-171e0df13a7a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.quota [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Created reservations ['a71eeacb-2f3d-4836-ace5-5b9f4471a622', 'bd8c20c3-3aea-4ce6-af66-8116f480b6a0', 'c261dbc8-bde1-4f3c-be38-712382faa8b2', '6ca61361-a4c6-404a-a099-46fc2c1c7d7e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341871616', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.manager [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:09:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Deleted volume successfully. Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c096498c-442a-4dd8-86e7-15dbcf75b816 tempest-TaggedAttachmentsTest-694590407 None] Lock "cinder-2509f860-ef4a-443f-9fc8-171e0df13a7a-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Flow 'volume_create_manager' (96e17395-76ef-42ed-9c68-feb15d284ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2837658-e40c-418b-ba2d-a9efca045127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2837658-e40c-418b-ba2d-a9efca045127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-4928667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9a4ad5f1-58f1-4934-b18f-9890ae47ecde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f138770c7b4407d83c449500fc000a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9f451298-7f42-4338-8b9f-45b9729f491e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:09:27Z,use_quota=True,user_id='6fe75acb64a94a2a88d370f43fa6b776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d859d2-4373-4d84-87d3-dea1995b8855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d859d2-4373-4d84-87d3-dea1995b8855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d96a823-bbf3-4bd5-b29c-e51ce0ced0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d96a823-bbf3-4bd5-b29c-e51ce0ced0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'volume_name': 'volume-9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'volume_size': 1, 'snapshot_id': '9f451298-7f42-4338-8b9f-45b9729f491e'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f61e3f-7054-4fe6-8f95-6a49f92ae0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f61e3f-7054-4fe6-8f95-6a49f92ae0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa600d9-485f-47aa-9d1e-b1b21dad1dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'volume_size': 1, 'snapshot_id': '9f451298-7f42-4338-8b9f-45b9729f491e'} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] create volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde from snapshot 9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] cloning s_9f451298-7f42-4338-8b9f-45b9729f491e to v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] create snapshot v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] create volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde from snapshot v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:09:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9f451298-7f42-4338-8b9f-45b9729f491e@v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'is_clone': True, 'full_name': 'Pool-0/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'name': 'v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] get volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9f451298-7f42-4338-8b9f-45b9729f491e@v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432377', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '108052', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3195293523390249393', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e672f3930cdcb135', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341859328', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78787', 'name': 'v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aa600d9-485f-47aa-9d1e-b1b21dad1dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'volume_size': 1, 'snapshot_id': '9f451298-7f42-4338-8b9f-45b9729f491e'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44235c5e-3e05-493d-abc6-d7435e40b7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Volume volume-9a4ad5f1-58f1-4934-b18f-9890ae47ecde (9a4ad5f1-58f1-4934-b18f-9890ae47ecde): created successfully Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44235c5e-3e05-493d-abc6-d7435e40b7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Flow 'volume_create_manager' (96e17395-76ef-42ed-9c68-feb15d284ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:28 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fa83cb4b-67d0-49d2-be4a-a03e9349702d tempest-TestStampPattern-1381824337 None] Created volume successfully. Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Acquiring lock "cinder-2024a461-c307-42e0-976a-bde8b1ef0bed-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Lock "cinder-2024a461-c307-42e0-976a-bde8b1ef0bed-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] remove_export for volume: 2024a461-c307-42e0-976a-bde8b1ef0bed. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-1546552654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2024a461-c307-42e0-976a-bde8b1ef0bed,launched_at=2023-04-14T00:05:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth='CHAP WjavJYiu cIWh4w5LDsd1NV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:09:34Z,updated_at=2023-04-14T00:09:34Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] detach volume v_2024a461-c307-42e0-976a-bde8b1ef0bed from target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed/luns/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] failed to remove resource iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed because of JDSS resource v_2024a461-c307-42e0-976a-bde8b1ef0bed DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] delete target: iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] delete target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] failed to remove resource iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed because of JDSS resource iqn.2010-10.org.openstack:2024a461-c307-42e0-976a-bde8b1ef0bed DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] deleating volume v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] get snapshots for volume v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] get volume v_2024a461-c307-42e0-976a-bde8b1ef0bed info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2024a461-c307-42e0-976a-bde8b1ef0bed', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432126', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107706', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2333961410435379851', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6385c33cb985ab7d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341847040', 'san:volume_id': '6385c33cb985ab7d0d5b6dcf7ede75006918b07c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '77298', 'name': 'v_2024a461-c307-42e0-976a-bde8b1ef0bed', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] delete volume:v_2024a461-c307-42e0-976a-bde8b1ef0bed recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2024a461-c307-42e0-976a-bde8b1ef0bed {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] volume v_2024a461-c307-42e0-976a-bde8b1ef0bed deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.quota [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Created reservations ['dec71977-7b3e-45d7-806e-55ceb6020293', 'f2cbd286-fbd7-4650-be24-b50a893dec15', 'ca0888d2-10f3-4790-99c7-fbd45505eca3', 'ceccfab1-be6f-4bce-b057-4ca76b2ad7f9'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Acquiring lock "cinder-c7267b8e-f20c-4625-b82d-b1a31a337714-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341941248', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.manager [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:09:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Deleted volume successfully. Apr 14 00:09:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Lock "cinder-c7267b8e-f20c-4625-b82d-b1a31a337714-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8f0aa04b-a64d-4fa2-9c8a-afee8bd1cc61 tempest-TestVolumeSwap-882310266 None] Lock "cinder-2024a461-c307-42e0-976a-bde8b1ef0bed-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] remove_export for volume: c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:05:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeSwap-volume-150766836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c7267b8e-f20c-4625-b82d-b1a31a337714,launched_at=2023-04-14T00:05:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293aba050c0e458a9d05bcbca5b49997',provider_auth='CHAP xEjqaYiH DC6FyeHmOsIU58',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:05:12Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:09:37Z,updated_at=2023-04-14T00:09:37Z,use_quota=True,user_id='6f81027ba772436092c0b317c3d5895d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] detach volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 from target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714/luns/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] failed to remove resource iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 because of JDSS resource v_c7267b8e-f20c-4625-b82d-b1a31a337714 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] delete target: iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] delete target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] failed to remove resource iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 because of JDSS resource iqn.2010-10.org.openstack:c7267b8e-f20c-4625-b82d-b1a31a337714 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] deleating volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] get snapshots for volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] get volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c7267b8e-f20c-4625-b82d-b1a31a337714', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432122', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9130077891641317235', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6343f4ac6684701b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341941248', 'san:volume_id': '6343f4ac6684701bd0934bbbfc206df161b7ff07', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78388', 'name': 'v_c7267b8e-f20c-4625-b82d-b1a31a337714', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] delete volume:v_c7267b8e-f20c-4625-b82d-b1a31a337714 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c7267b8e-f20c-4625-b82d-b1a31a337714 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] volume v_c7267b8e-f20c-4625-b82d-b1a31a337714 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.quota [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Created reservations ['6e36d7fb-c898-4d1b-82bd-ecec32643a80', '92c9dbf2-b836-41c5-840f-2d7f5a8e0a55', '3114644b-efae-4baa-bf71-21ca446a0f78', '548890a3-4295-41b1-b28f-026434bbcdb0'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Geting {'code': 200, 'error': None, 'data': {'available': '114342035456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:09:40 user cinder-volume[84560]: DEBUG cinder.manager [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:09:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Deleted volume successfully. Apr 14 00:09:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1bd9eb86-dd22-4d28-87da-21abedd3ccc5 tempest-TestVolumeSwap-882310266 None] Lock "cinder-c7267b8e-f20c-4625-b82d-b1a31a337714-delete_volume" released by "delete_volume" :: held 3.339s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:09:54 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=25,cinder:SELECT=64,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:54 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=49,cinder:UPDATE=34,cinder:INSERT=7,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:09:54 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:09:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Flow 'volume_create_manager' (113152fd-d7ea-43f0-b916-fb5d6dfbf4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7532df8f-04e0-4a2a-9dd9-24fbd2ee6c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7532df8f-04e0-4a2a-9dd9-24fbd2ee6c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1330232612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=70173bca-df37-41ee-adcb-1e0464d96d62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:09:55Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0fa94-9844-4149-b418-4ac6a606f788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a0fa94-9844-4149-b418-4ac6a606f788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b12f1a-3893-4509-9276-e7a57eecf4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b12f1a-3893-4509-9276-e7a57eecf4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70173bca-df37-41ee-adcb-1e0464d96d62', 'volume_name': 'volume-70173bca-df37-41ee-adcb-1e0464d96d62', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1cb071-513d-4b0f-95a8-a5b4ff9f5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1cb071-513d-4b0f-95a8-a5b4ff9f5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cbe111-3625-4cb4-a563-32663d4e43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:55 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume 70173bca-df37-41ee-adcb-1e0464d96d62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70173bca-df37-41ee-adcb-1e0464d96d62', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Cloning 70173bca-df37-41ee-adcb-1e0464d96d62 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 9, 55, 138055)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 9, 55, 152342)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] create snapshot v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_70173bca-df37-41ee-adcb-1e0464d96d62'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] create volume v_70173bca-df37-41ee-adcb-1e0464d96d62 from snapshot v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:09:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_70173bca-df37-41ee-adcb-1e0464d96d62', 'is_clone': True, 'full_name': 'Pool-0/v_70173bca-df37-41ee-adcb-1e0464d96d62', 'name': 'v_70173bca-df37-41ee-adcb-1e0464d96d62'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] get volume v_70173bca-df37-41ee-adcb-1e0464d96d62 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_70173bca-df37-41ee-adcb-1e0464d96d62', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_70173bca-df37-41ee-adcb-1e0464d96d62', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432406', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108064', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3682031358069928580', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '37b4a7e3f235839e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341998592', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78689', 'name': 'v_70173bca-df37-41ee-adcb-1e0464d96d62', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Marking volume 70173bca-df37-41ee-adcb-1e0464d96d62 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 70173bca-df37-41ee-adcb-1e0464d96d62. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Creating volume glance metadata for volume 70173bca-df37-41ee-adcb-1e0464d96d62 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cbe111-3625-4cb4-a563-32663d4e43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70173bca-df37-41ee-adcb-1e0464d96d62', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fb4ca4-1ef0-4e02-bbdd-1adf08c3dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:57 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume volume-70173bca-df37-41ee-adcb-1e0464d96d62 (70173bca-df37-41ee-adcb-1e0464d96d62): created successfully Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fb4ca4-1ef0-4e02-bbdd-1adf08c3dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Flow 'volume_create_manager' (113152fd-d7ea-43f0-b916-fb5d6dfbf4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:57 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5c6914ef-97b1-4f8b-bba0-68ac514d0f85 tempest-TaggedBootDevicesTest_v242-1295697559 None] Created volume successfully. Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Flow 'volume_create_manager' (49be0682-b8be-446f-a409-389de348853a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fce301-1315-4a9d-a8b9-afdd65a12921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fce301-1315-4a9d-a8b9-afdd65a12921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-902201793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94fa4f60-6d5e-4c7b-b5a6-0923600a26e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:09:58Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f925809b-ead0-4a55-b722-58b68084b3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f925809b-ead0-4a55-b722-58b68084b3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b918f19f-b192-4c94-9969-867d61c7284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b918f19f-b192-4c94-9969-867d61c7284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'volume_name': 'volume-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd041dd-ec57-47a9-a0ed-4c0bb481ea0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dd041dd-ec57-47a9-a0ed-4c0bb481ea0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc213a8-0a98-4846-af2b-7313311b4f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:58 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'volume_size': 1} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] creating volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] create volume {'name': 'v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'is_clone': False, 'name': 'v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc213a8-0a98-4846-af2b-7313311b4f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de18ea2-bc2d-4b5e-a0b9-607f5beae62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:59 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume volume-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 (94fa4f60-6d5e-4c7b-b5a6-0923600a26e0): created successfully Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1de18ea2-bc2d-4b5e-a0b9-607f5beae62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Flow 'volume_create_manager' (49be0682-b8be-446f-a409-389de348853a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:59 user cinder-volume[84560]: INFO cinder.volume.manager [None req-673ef2eb-aa69-4c37-83d2-a310e05b7ded tempest-TaggedBootDevicesTest_v242-1295697559 None] Created volume successfully. Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Flow 'volume_create_manager' (fb9b2a26-7497-4103-b247-a397785b0520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e02d59f-e7d3-4d71-abe5-685932025a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e02d59f-e7d3-4d71-abe5-685932025a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-281782003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=215fee6a-a733-4408-a162-1e700d5bf7fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:10:00Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87b1a0a-7d64-49c8-9dc2-de82934c5263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f87b1a0a-7d64-49c8-9dc2-de82934c5263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fe0ceb-3e3a-45b5-ab06-e68c96366efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0fe0ceb-3e3a-45b5-ab06-e68c96366efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215fee6a-a733-4408-a162-1e700d5bf7fc', 'volume_name': 'volume-215fee6a-a733-4408-a162-1e700d5bf7fc', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f815ff-b8ca-4ce4-8ba7-0943817b0c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78f815ff-b8ca-4ce4-8ba7-0943817b0c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d05c71-3b0a-44a8-82b1-610269fe3cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:09:59 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume 215fee6a-a733-4408-a162-1e700d5bf7fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215fee6a-a733-4408-a162-1e700d5bf7fc', 'volume_size': 1} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] creating volume v_215fee6a-a733-4408-a162-1e700d5bf7fc. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] create volume {'name': 'v_215fee6a-a733-4408-a162-1e700d5bf7fc', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:09:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_215fee6a-a733-4408-a162-1e700d5bf7fc', 'is_clone': False, 'name': 'v_215fee6a-a733-4408-a162-1e700d5bf7fc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53d05c71-3b0a-44a8-82b1-610269fe3cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215fee6a-a733-4408-a162-1e700d5bf7fc', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec68c28c-e3ea-460e-bc92-0fd8419da293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:00 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Volume volume-215fee6a-a733-4408-a162-1e700d5bf7fc (215fee6a-a733-4408-a162-1e700d5bf7fc): created successfully Apr 14 00:10:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec68c28c-e3ea-460e-bc92-0fd8419da293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Flow 'volume_create_manager' (fb9b2a26-7497-4103-b247-a397785b0520) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:10:00 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3cea8509-7d47-48e3-a641-aaedefe45be7 tempest-TaggedBootDevicesTest_v242-1295697559 None] Created volume successfully. Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] create export for volume: 70173bca-df37-41ee-adcb-1e0464d96d62. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] ensure volume 70173bca-df37-41ee-adcb-1e0464d96d62 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] check if targe iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] create target and attach volume 70173bca-df37-41ee-adcb-1e0464d96d62 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] create target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] atach volume v_70173bca-df37-41ee-adcb-1e0464d96d62 to target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (fdd3f5b7-c7a0-42ef-81be-914173621c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354980f3-99c5-45ff-addb-2566f42e51be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354980f3-99c5-45ff-addb-2566f42e51be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741624963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47f758b3-4f9f-43c6-bd95-efdf4732751b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:10:18Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c6d549-9faf-40ae-8a91-1a68fb0e329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c6d549-9faf-40ae-8a91-1a68fb0e329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b598af8f-f064-41e5-9507-25ceb89fd9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b598af8f-f064-41e5-9507-25ceb89fd9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47f758b3-4f9f-43c6-bd95-efdf4732751b', 'volume_name': 'volume-47f758b3-4f9f-43c6-bd95-efdf4732751b', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df35e3-66d1-4bf7-81e6-e606770cc041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04df35e3-66d1-4bf7-81e6-e606770cc041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80c334d-7e9c-488a-9238-30330b540c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:17 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Volume 47f758b3-4f9f-43c6-bd95-efdf4732751b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47f758b3-4f9f-43c6-bd95-efdf4732751b', 'volume_size': 1} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] creating volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] create volume {'name': 'v_47f758b3-4f9f-43c6-bd95-efdf4732751b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3337623461376533', 'lun': 0, 'mode': 'wt', 'name': 'v_70173bca-df37-41ee-adcb-1e0464d96d62', 'prod_id': 'Storage', 'scsi_id': '37b4a7e3f235839e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] add credentails to target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:10:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_47f758b3-4f9f-43c6-bd95-efdf4732751b', 'is_clone': False, 'name': 'v_47f758b3-4f9f-43c6-bd95-efdf4732751b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80c334d-7e9c-488a-9238-30330b540c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f758b3-4f9f-43c6-bd95-efdf4732751b', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c264c9a-a54f-4f65-a4c7-1e5ed3a073e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:19 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Volume volume-47f758b3-4f9f-43c6-bd95-efdf4732751b (47f758b3-4f9f-43c6-bd95-efdf4732751b): created successfully Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c264c9a-a54f-4f65-a4c7-1e5ed3a073e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (fdd3f5b7-c7a0-42ef-81be-914173621c98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:10:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-22d04a2d-1d91-4a86-8535-46025856b0ca tempest-VolumesActionsTest-599923376 None] Created volume successfully. Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'name': 'XKCdSwHe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] initialize_connection for 70173bca-df37-41ee-adcb-1e0464d96d62 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XKCdSwHe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'c3f8ef01-a91c-46c3-b28f-664c6a038a53'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:10:19 user cinder-volume[84560]: INFO cinder.volume.manager [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-576c1147-e871-41fc-9eb7-a68d630bea65 tempest-TaggedBootDevicesTest_v242-1295697559 None] attachment_update completed successfully. Apr 14 00:10:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-03d534ff-ac43-483f-9bef-90f7ca12cdb1 tempest-VolumesActionsTest-599923376 None] Acquiring lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b" by "attach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-03d534ff-ac43-483f-9bef-90f7ca12cdb1 tempest-VolumesActionsTest-599923376 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b" acquired by "attach_volume" :: waited 0.034s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:10:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-03d534ff-ac43-483f-9bef-90f7ca12cdb1 tempest-VolumesActionsTest-599923376 None] Attaching volume 47f758b3-4f9f-43c6-bd95-efdf4732751b to instance db291c2f-a72c-46ce-8de8-3956de37ccf8 at mountpoint /dev/vdb on host None. Apr 14 00:10:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-03d534ff-ac43-483f-9bef-90f7ca12cdb1 tempest-VolumesActionsTest-599923376 None] Attach volume completed successfully. Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-03d534ff-ac43-483f-9bef-90f7ca12cdb1 tempest-VolumesActionsTest-599923376 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b" released by "attach_volume" :: held 0.132s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] create export for volume: 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] ensure volume 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] check if targe iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] create target and attach volume 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] create target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] terminate connection for 47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:10:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Terminate volume connection completed successfully. Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Acquiring lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-detach_volume" by "detach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:10:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Detaching volume 47f758b3-4f9f-43c6-bd95-efdf4732751b from instance db291c2f-a72c-46ce-8de8-3956de37ccf8. Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] remove_export for volume: 47f758b3-4f9f-43c6-bd95-efdf4732751b. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] detach volume:Volume(_name_id=None,admin_metadata={attached_mode='rw',readonly='False'},attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741624963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47f758b3-4f9f-43c6-bd95-efdf4732751b,launched_at=2023-04-14T00:10:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP OHdNgybE UBJlVLT72jgKsw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:18Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='error',terminated_at=None,updated_at=2023-04-14T00:10:21Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] detach volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b from target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:10:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:10:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:10:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114341728256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:10:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] atach volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 to target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b because of JDSS resource v_47f758b3-4f9f-43c6-bd95-efdf4732751b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] delete target: iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] delete target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6236343039616666', 'lun': 0, 'mode': 'wt', 'name': 'v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'prod_id': 'Storage', 'scsi_id': 'b6409aff2f46b628'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] add credentails to target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b because of JDSS resource iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:10:24 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Detach volume completed successfully. Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a2a6cd80-8fed-4c28-a6e0-a1c1d981592d tempest-VolumesActionsTest-1080925101 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-detach_volume" released by "detach_volume" :: held 3.872s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'name': 'KBCYoGZf'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] initialize_connection for 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KBCYoGZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'db90ce2b-b052-4826-bd61-45ecc34ca9f8'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-20f26683-fc95-4967-8548-01e0f9ad0537 tempest-VolumesActionsTest-599923376 None] Acquiring lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-detach_volume" by "detach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-20f26683-fc95-4967-8548-01e0f9ad0537 tempest-VolumesActionsTest-599923376 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:10:24 user cinder-volume[84560]: INFO cinder.volume.manager [None req-20f26683-fc95-4967-8548-01e0f9ad0537 tempest-VolumesActionsTest-599923376 None] Volume detach called, but volume not attached. Apr 14 00:10:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-20f26683-fc95-4967-8548-01e0f9ad0537 tempest-VolumesActionsTest-599923376 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:10:24 user cinder-volume[84560]: INFO cinder.volume.manager [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4df7004e-19c1-4f9a-9a0f-43ef527625fb tempest-TaggedBootDevicesTest_v242-1295697559 None] attachment_update completed successfully. Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Acquiring lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=76,cinder:UPDATE=18,cinder:INSERT=3,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=63,cinder:UPDATE=19,cinder:INSERT=11,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] remove_export for volume: 47f758b3-4f9f-43c6-bd95-efdf4732751b. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-741624963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=47f758b3-4f9f-43c6-bd95-efdf4732751b,launched_at=2023-04-14T00:10:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP OHdNgybE UBJlVLT72jgKsw',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:18Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:10:25Z,updated_at=2023-04-14T00:10:25Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] detach volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b from target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b/luns/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] failed to remove resource iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b because of JDSS resource v_47f758b3-4f9f-43c6-bd95-efdf4732751b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] delete target: iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] delete target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] failed to remove resource iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b because of JDSS resource iqn.2010-10.org.openstack:47f758b3-4f9f-43c6-bd95-efdf4732751b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] deleating volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] get snapshots for volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] create export for volume: 215fee6a-a733-4408-a162-1e700d5bf7fc. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] ensure volume 215fee6a-a733-4408-a162-1e700d5bf7fc assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] check if targe iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] get volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] create target and attach volume 215fee6a-a733-4408-a162-1e700d5bf7fc to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] create target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_47f758b3-4f9f-43c6-bd95-efdf4732751b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432428', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108083', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13370447479928986083', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cc2fa35418d6ba07', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341715968', 'san:volume_id': 'cc2fa35418d6ba0778c5c2cee47357fa04e36e08', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '77434', 'name': 'v_47f758b3-4f9f-43c6-bd95-efdf4732751b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] delete volume:v_47f758b3-4f9f-43c6-bd95-efdf4732751b recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] atach volume v_215fee6a-a733-4408-a162-1e700d5bf7fc to target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:10:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_47f758b3-4f9f-43c6-bd95-efdf4732751b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] volume v_47f758b3-4f9f-43c6-bd95-efdf4732751b deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:10:29 user cinder-volume[84560]: DEBUG cinder.quota [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Created reservations ['6dfd48bc-9331-45ab-b42a-d881be376b60', 'b7fe96d0-771e-46ed-a8b0-77e4d5ae0dfd', '07d1cc47-ee95-4444-8a56-b3c6c683df9e', '7effeaa6-2484-4675-8729-6c61d3467d94'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:10:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:10:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:10:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3834353630623965', 'lun': 0, 'mode': 'wt', 'name': 'v_215fee6a-a733-4408-a162-1e700d5bf7fc', 'prod_id': 'Storage', 'scsi_id': '84560b9e7982ccc4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] add credentails to target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341785600', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:10:31 user cinder-volume[84560]: DEBUG cinder.manager [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:10:32 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Deleted volume successfully. Apr 14 00:10:32 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f83902a7-d79d-4b22-92f6-766f154c6f24 tempest-VolumesActionsTest-599923376 None] Lock "cinder-47f758b3-4f9f-43c6-bd95-efdf4732751b-delete_volume" released by "delete_volume" :: held 6.907s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:10:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 201, 'error': None, 'data': {'name': 'jPSrRZvK'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] initialize_connection for 215fee6a-a733-4408-a162-1e700d5bf7fc 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:10:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jPSrRZvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'b4b24ae2-8900-4476-bc99-6ab4831f3406'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:10:32 user cinder-volume[84560]: INFO cinder.volume.manager [req-487e0f7f-3fe9-4968-a7cb-f4b448fcef6b req-4087645f-75a0-4b32-9ad3-c948cb27f36d tempest-TaggedBootDevicesTest_v242-1295697559 None] attachment_update completed successfully. Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] terminate connection for af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:10:39 user cinder-volume[84560]: INFO cinder.volume.manager [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Terminate volume connection completed successfully. Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Deleting attachment 355a8c10-71ab-4aed-9e38-b43ec2211c2a. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] remove_export for volume: af1b05d2-717a-489c-8bdf-160d00ebd122. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1863658117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=af1b05d2-717a-489c-8bdf-160d00ebd122,launched_at=2023-04-14T00:06:53Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='4f20caf676a64b9b97027f3fc9bc724c',provider_auth='CHAP dekLAOnU ga78o1DC2Jwvyk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:10:38Z,use_quota=True,user_id='2f8b18d40ecd4b4e976cf2018af8220c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] detach volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 from target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] delete target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] delete target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e6300b39-c3bd-43c3-8d36-cadb15388b15 req-81704a6f-1afe-4b79-b19f-c2fd1fb4835e tempest-AttachVolumeShelveTestJSON-1395403129 None] target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:10:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:10:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Flow 'volume_create_manager' (0651813c-130a-4189-9d91-e621d1d5e59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:10:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03ee342-c870-4d7f-8749-6b9d1bc5a862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03ee342-c870-4d7f-8749-6b9d1bc5a862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-665478096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb161de0-be74-4875-be21-dbca6bfcfc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffbe999e60a4add9f23c83f9b0a4252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:10:42Z,use_quota=True,user_id='74d7e3d598e74c288e6a44996303b85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ed2b51-7e57-4fb2-8cac-0a79349219bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37ed2b51-7e57-4fb2-8cac-0a79349219bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af723e20-4ddd-4269-b9db-5b5631a0114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af723e20-4ddd-4269-b9db-5b5631a0114b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb161de0-be74-4875-be21-dbca6bfcfc22', 'volume_name': 'volume-bb161de0-be74-4875-be21-dbca6bfcfc22', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53927248-6727-4875-875d-b87440923725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53927248-6727-4875-875d-b87440923725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b259bde-f08d-45a5-8d57-5751bccfe1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:42 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Volume bb161de0-be74-4875-be21-dbca6bfcfc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb161de0-be74-4875-be21-dbca6bfcfc22', 'volume_size': 1} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] creating volume v_bb161de0-be74-4875-be21-dbca6bfcfc22. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] create volume {'name': 'v_bb161de0-be74-4875-be21-dbca6bfcfc22', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bb161de0-be74-4875-be21-dbca6bfcfc22', 'is_clone': False, 'name': 'v_bb161de0-be74-4875-be21-dbca6bfcfc22'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b259bde-f08d-45a5-8d57-5751bccfe1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb161de0-be74-4875-be21-dbca6bfcfc22', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7097f48-9c58-449c-baff-dda2b1adfc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:10:43 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Volume volume-bb161de0-be74-4875-be21-dbca6bfcfc22 (bb161de0-be74-4875-be21-dbca6bfcfc22): created successfully Apr 14 00:10:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7097f48-9c58-449c-baff-dda2b1adfc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:10:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Flow 'volume_create_manager' (0651813c-130a-4189-9d91-e621d1d5e59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:10:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d4a5f3b5-8e95-429f-9bb1-fd52c1d0ac21 tempest-VolumesAdminNegativeTest-1377720460 None] Created volume successfully. Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] create export for volume: bb161de0-be74-4875-be21-dbca6bfcfc22. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] ensure volume bb161de0-be74-4875-be21-dbca6bfcfc22 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] check if targe iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] create target and attach volume bb161de0-be74-4875-be21-dbca6bfcfc22 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] create target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] terminate connection for 5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:10:45 user cinder-volume[84560]: INFO cinder.volume.manager [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Terminate volume connection completed successfully. Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Deleting attachment 3ee3e773-1a7c-47ce-b628-8897d5895513. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] remove_export for volume: 5021c122-fea0-4125-8b1f-c1ab3c4de5e7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-155776098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5021c122-fea0-4125-8b1f-c1ab3c4de5e7,launched_at=2023-04-14T00:06:53Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth='CHAP npILkxwF Vg2EonFjihLZT1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:10:44Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] detach volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 from target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] delete target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] delete target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a9394194-1477-494d-98b0-71819c4e4134 req-67664adb-e0b0-4f35-b557-833f4ecc1db6 tempest-AttachVolumeTestJSON-1885059489 None] target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:10:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] atach volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 to target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:10:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3961656663623163', 'lun': 0, 'mode': 'wt', 'name': 'v_bb161de0-be74-4875-be21-dbca6bfcfc22', 'prod_id': 'Storage', 'scsi_id': '9aefcb1c572827de'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] add credentails to target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:10:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 201, 'error': None, 'data': {'name': 'LEcXASpF'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] initialize_connection for bb161de0-be74-4875-be21-dbca6bfcfc22 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:10:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LEcXASpF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '230eabb9-f683-4619-b7c2-d60679414559'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:10:50 user cinder-volume[84560]: INFO cinder.volume.manager [req-94ce69ce-843c-49e6-aa7d-15437cf1d265 req-578fd3ab-dbf2-4376-9156-b43b2f516cd4 tempest-VolumesAdminNegativeTest-1377720460 None] attachment_update completed successfully. Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] terminate connection for bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:10:55 user cinder-volume[84560]: INFO cinder.volume.manager [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Terminate volume connection completed successfully. Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Deleting attachment 230eabb9-f683-4619-b7c2-d60679414559. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] remove_export for volume: bb161de0-be74-4875-be21-dbca6bfcfc22. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-665478096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb161de0-be74-4875-be21-dbca6bfcfc22,launched_at=2023-04-14T00:10:43Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='dffbe999e60a4add9f23c83f9b0a4252',provider_auth='CHAP LEcXASpF w4RraemQNLqbMh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:42Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:10:54Z,use_quota=True,user_id='74d7e3d598e74c288e6a44996303b85e',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] detach volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 from target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=52,cinder:UPDATE=18,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=46,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] delete target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] delete target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:10:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-cc975729-3d1e-4d9e-9a38-6d1608b78d75 req-0e011e5b-44bd-44b2-9cfa-ef457b71e81b tempest-VolumesAdminNegativeTest-1377720460 None] target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:11:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] terminate connection for 028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:11:17 user cinder-volume[84560]: INFO cinder.volume.manager [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Terminate volume connection completed successfully. Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Deleting attachment 679e00ff-1e9f-4d7a-83d1-85056920732d. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] remove_export for volume: 028eff5c-aa61-4243-985e-5210aedff04a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-811798238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=028eff5c-aa61-4243-985e-5210aedff04a,launched_at=2023-04-14T00:08:42Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='c931198e56de4cf08db59bcc40f2a260',provider_auth='CHAP iVbjylRT oIuhxkLTlzeYDO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:11:16Z,use_quota=True,user_id='97374cd3cdc448cd8710561d44756ead',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] detach volume v_028eff5c-aa61-4243-985e-5210aedff04a from target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] delete target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] delete target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-df32b9ba-8057-4d59-8810-06f9cd52e565 req-f392bf1f-5983-443e-827b-2d4127c401bd tempest-ServerStableDeviceRescueTest-481368698 None] target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (ade21397-23ec-4ff2-88f7-001bb3b96940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25cac2-b0e2-4463-9537-6a4f9fff1c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f25cac2-b0e2-4463-9537-6a4f9fff1c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1276443023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d16005e2-c5bd-4dfd-9898-90a73e19b977,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:11:21Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d414cd0-cf29-444f-a5a3-4bae40038f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d414cd0-cf29-444f-a5a3-4bae40038f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd11e029-6a87-4847-8a1e-61d4e724c140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd11e029-6a87-4847-8a1e-61d4e724c140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd16005e2-c5bd-4dfd-9898-90a73e19b977', 'volume_name': 'volume-d16005e2-c5bd-4dfd-9898-90a73e19b977', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5449987a-fa44-4c43-a745-6e865abb4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5449987a-fa44-4c43-a745-6e865abb4c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9b5991-abbe-4514-8de4-c1e175ae82d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:21 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Volume d16005e2-c5bd-4dfd-9898-90a73e19b977: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d16005e2-c5bd-4dfd-9898-90a73e19b977', 'volume_size': 1} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] creating volume v_d16005e2-c5bd-4dfd-9898-90a73e19b977. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] create volume {'name': 'v_d16005e2-c5bd-4dfd-9898-90a73e19b977', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331537408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d16005e2-c5bd-4dfd-9898-90a73e19b977', 'is_clone': False, 'name': 'v_d16005e2-c5bd-4dfd-9898-90a73e19b977'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb9b5991-abbe-4514-8de4-c1e175ae82d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d16005e2-c5bd-4dfd-9898-90a73e19b977', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addf216e-0c84-4cc3-aee1-0bf30607ff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:22 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Volume volume-d16005e2-c5bd-4dfd-9898-90a73e19b977 (d16005e2-c5bd-4dfd-9898-90a73e19b977): created successfully Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (addf216e-0c84-4cc3-aee1-0bf30607ff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (ade21397-23ec-4ff2-88f7-001bb3b96940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:22 user cinder-volume[84560]: INFO cinder.volume.manager [None req-16a82822-1e66-4064-9b94-8a6e1e049745 tempest-VolumesActionsTest-599923376 None] Created volume successfully. Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Acquiring lock "cinder-d16005e2-c5bd-4dfd-9898-90a73e19b977-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Lock "cinder-d16005e2-c5bd-4dfd-9898-90a73e19b977-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] remove_export for volume: d16005e2-c5bd-4dfd-9898-90a73e19b977. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1276443023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d16005e2-c5bd-4dfd-9898-90a73e19b977,launched_at=2023-04-14T00:11:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP GbeQfIxR h67LmWptrqxzFU',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:21Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:11:24Z,updated_at=2023-04-14T00:11:24Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] detach volume v_d16005e2-c5bd-4dfd-9898-90a73e19b977 from target iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977/luns/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977/luns/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977/luns/v_d16005e2-c5bd-4dfd-9898-90a73e19b977'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977/luns/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 because of JDSS resource v_d16005e2-c5bd-4dfd-9898-90a73e19b977 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] delete target: iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] delete target iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 because of JDSS resource iqn.2010-10.org.openstack:d16005e2-c5bd-4dfd-9898-90a73e19b977 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] deleating volume v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] get snapshots for volume v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] get volume v_d16005e2-c5bd-4dfd-9898-90a73e19b977 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d16005e2-c5bd-4dfd-9898-90a73e19b977', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432491', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108115', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13579192589083895805', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '56efbd790038887a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331443200', 'san:volume_id': '56efbd790038887aa2401fc378163e7e6ed55da8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78167', 'name': 'v_d16005e2-c5bd-4dfd-9898-90a73e19b977', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] delete volume:v_d16005e2-c5bd-4dfd-9898-90a73e19b977 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] create export for volume: 9a4ad5f1-58f1-4934-b18f-9890ae47ecde. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] ensure volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] check if targe iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] create target and attach volume 9a4ad5f1-58f1-4934-b18f-9890ae47ecde to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] create target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d16005e2-c5bd-4dfd-9898-90a73e19b977 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] volume v_d16005e2-c5bd-4dfd-9898-90a73e19b977 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.quota [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Created reservations ['98eaec7f-da50-4e20-8eb7-4c02a74fdd93', 'ec4445e2-64e6-45ce-98c6-21e8be3fcc46', 'e0d75970-65a2-45ef-a1ce-0e915f8ca8ea', '9b028bc6-d808-4dde-92ef-71dbf874f343'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331537408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:26 user cinder-volume[84560]: DEBUG cinder.manager [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Deleted volume successfully. Apr 14 00:11:26 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4a1a0798-93da-4d89-b6ee-f3477359b744 tempest-VolumesActionsTest-1080925101 None] Lock "cinder-d16005e2-c5bd-4dfd-9898-90a73e19b977-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (4beacfc0-d903-4e9b-a372-252f95b8b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de9f595-3190-441e-bbd7-561093fb1114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2de9f595-3190-441e-bbd7-561093fb1114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562190811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3129aa01-24a9-4754-bb34-7aaf0577f01f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:11:27Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f6c1e-d5d5-4414-871d-a65d9724a70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72f6c1e-d5d5-4414-871d-a65d9724a70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc2216f-d8ad-4857-bf9a-fb0c914f6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bc2216f-d8ad-4857-bf9a-fb0c914f6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3129aa01-24a9-4754-bb34-7aaf0577f01f', 'volume_name': 'volume-3129aa01-24a9-4754-bb34-7aaf0577f01f', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ccdd60-d9ed-4bb2-9c96-1b63e4a37ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ccdd60-d9ed-4bb2-9c96-1b63e4a37ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10ffd83-c913-4da9-9324-92723813ebba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:27 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Volume 3129aa01-24a9-4754-bb34-7aaf0577f01f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3129aa01-24a9-4754-bb34-7aaf0577f01f', 'volume_size': 1} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] creating volume v_3129aa01-24a9-4754-bb34-7aaf0577f01f. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] create volume {'name': 'v_3129aa01-24a9-4754-bb34-7aaf0577f01f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] atach volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde to target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3129aa01-24a9-4754-bb34-7aaf0577f01f', 'is_clone': False, 'name': 'v_3129aa01-24a9-4754-bb34-7aaf0577f01f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c10ffd83-c913-4da9-9324-92723813ebba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3129aa01-24a9-4754-bb34-7aaf0577f01f', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a758956-c1c3-40b8-9d3e-1de1de8392b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Volume volume-3129aa01-24a9-4754-bb34-7aaf0577f01f (3129aa01-24a9-4754-bb34-7aaf0577f01f): created successfully Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a758956-c1c3-40b8-9d3e-1de1de8392b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (4beacfc0-d903-4e9b-a372-252f95b8b134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:28 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3996f02d-0200-45ae-8038-6fb53bf63fb0 tempest-VolumesActionsTest-599923376 None] Created volume successfully. Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Acquiring lock "cinder-3129aa01-24a9-4754-bb34-7aaf0577f01f-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Lock "cinder-3129aa01-24a9-4754-bb34-7aaf0577f01f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] remove_export for volume: 3129aa01-24a9-4754-bb34-7aaf0577f01f. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-562190811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3129aa01-24a9-4754-bb34-7aaf0577f01f,launched_at=2023-04-14T00:11:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP TPJOYUXr J1t8o2M0LEvUXn',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:27Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:11:28Z,updated_at=2023-04-14T00:11:28Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] detach volume v_3129aa01-24a9-4754-bb34-7aaf0577f01f from target iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f/luns/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f/luns/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f/luns/v_3129aa01-24a9-4754-bb34-7aaf0577f01f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f/luns/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f because of JDSS resource v_3129aa01-24a9-4754-bb34-7aaf0577f01f DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] delete target: iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] delete target iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f because of JDSS resource iqn.2010-10.org.openstack:3129aa01-24a9-4754-bb34-7aaf0577f01f DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] deleating volume v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] get snapshots for volume v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6536373266333933', 'lun': 0, 'mode': 'wt', 'name': 'v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'prod_id': 'Storage', 'scsi_id': 'e672f3930cdcb135'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] add credentails to target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] get volume v_3129aa01-24a9-4754-bb34-7aaf0577f01f info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3129aa01-24a9-4754-bb34-7aaf0577f01f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432497', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108120', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13716176243577672186', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '942c418664bc1f8a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331443200', 'san:volume_id': '942c418664bc1f8a4f5def0cd726ddc28b12598b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78178', 'name': 'v_3129aa01-24a9-4754-bb34-7aaf0577f01f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] delete volume:v_3129aa01-24a9-4754-bb34-7aaf0577f01f recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PTrqskZW'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] initialize_connection for 9a4ad5f1-58f1-4934-b18f-9890ae47ecde 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:11:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTrqskZW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9d5d69c6-e22a-4e28-8616-ca5a56ff488a'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:11:29 user cinder-volume[84560]: INFO cinder.volume.manager [req-27919267-f13b-4101-935e-c17a0618e983 req-7682d9ac-af9f-4631-912d-c23253862b05 tempest-TestStampPattern-1381824337 None] attachment_update completed successfully. Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3129aa01-24a9-4754-bb34-7aaf0577f01f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] volume v_3129aa01-24a9-4754-bb34-7aaf0577f01f deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Created reservations ['965941a3-85b1-4fe1-959c-5d0b8a22fc61', '8286b0f8-5be0-460e-9e66-6bd16787d8f6', 'eb4a5224-1d10-40a8-8fa6-0aa5d6279c9c', '178ab389-786e-4c75-9395-8a84d17708ca'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331525120', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.manager [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Deleted volume successfully. Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c59d5f7f-6a63-4738-ab00-8506fbf4ce63 tempest-VolumesActionsTest-1080925101 None] Lock "cinder-3129aa01-24a9-4754-bb34-7aaf0577f01f-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (2f9fd63d-5396-4b1b-ba18-09852c3a718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cad8883-0bc2-4a14-aa93-3b56f0b226b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cad8883-0bc2-4a14-aa93-3b56f0b226b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-592996673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1ed186c7-3e6f-44a0-951f-c3d892647153,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:11:32Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6a1229-671c-43b2-af33-dd67fd2e7e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b6a1229-671c-43b2-af33-dd67fd2e7e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282ad823-bbc1-4390-a145-12d13bdd40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282ad823-bbc1-4390-a145-12d13bdd40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed186c7-3e6f-44a0-951f-c3d892647153', 'volume_name': 'volume-1ed186c7-3e6f-44a0-951f-c3d892647153', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93983876-638b-41dd-af1e-dd7787625986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93983876-638b-41dd-af1e-dd7787625986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6010ae7c-7082-42ea-a91d-1171939bbc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:32 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Volume 1ed186c7-3e6f-44a0-951f-c3d892647153: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed186c7-3e6f-44a0-951f-c3d892647153', 'volume_size': 1} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] creating volume v_1ed186c7-3e6f-44a0-951f-c3d892647153. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] create volume {'name': 'v_1ed186c7-3e6f-44a0-951f-c3d892647153', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1ed186c7-3e6f-44a0-951f-c3d892647153', 'is_clone': False, 'name': 'v_1ed186c7-3e6f-44a0-951f-c3d892647153'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6010ae7c-7082-42ea-a91d-1171939bbc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed186c7-3e6f-44a0-951f-c3d892647153', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc5e235-4f10-4ea9-9cdf-fce904564d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:33 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Volume volume-1ed186c7-3e6f-44a0-951f-c3d892647153 (1ed186c7-3e6f-44a0-951f-c3d892647153): created successfully Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc5e235-4f10-4ea9-9cdf-fce904564d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (2f9fd63d-5396-4b1b-ba18-09852c3a718d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:33 user cinder-volume[84560]: INFO cinder.volume.manager [None req-14c26ac8-6828-490a-866d-5ceab5081b3d tempest-VolumesActionsTest-599923376 None] Created volume successfully. Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] terminate connection for 9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:11:33 user cinder-volume[84560]: INFO cinder.volume.manager [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Terminate volume connection completed successfully. Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Deleting attachment 9d5d69c6-e22a-4e28-8616-ca5a56ff488a. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] remove_export for volume: 9a4ad5f1-58f1-4934-b18f-9890ae47ecde. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-4928667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9a4ad5f1-58f1-4934-b18f-9890ae47ecde,launched_at=2023-04-14T00:09:29Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='1f138770c7b4407d83c449500fc000a5',provider_auth='CHAP PTrqskZW YuePStWclkoE8j',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:27Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=9f451298-7f42-4338-8b9f-45b9729f491e,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:11:33Z,use_quota=True,user_id='6fe75acb64a94a2a88d370f43fa6b776',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] detach volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde from target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] delete target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] delete target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Acquiring lock "cinder-1ed186c7-3e6f-44a0-951f-c3d892647153-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Lock "cinder-1ed186c7-3e6f-44a0-951f-c3d892647153-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] remove_export for volume: 1ed186c7-3e6f-44a0-951f-c3d892647153. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-592996673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1ed186c7-3e6f-44a0-951f-c3d892647153,launched_at=2023-04-14T00:11:33Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP fpFzntal c9qIwauXTvKZBE',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:32Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:11:34Z,updated_at=2023-04-14T00:11:34Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] detach volume v_1ed186c7-3e6f-44a0-951f-c3d892647153 from target iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153/luns/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153/luns/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153/luns/v_1ed186c7-3e6f-44a0-951f-c3d892647153'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153/luns/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 because of JDSS resource v_1ed186c7-3e6f-44a0-951f-c3d892647153 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] delete target: iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] delete target iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 because of JDSS resource iqn.2010-10.org.openstack:1ed186c7-3e6f-44a0-951f-c3d892647153 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] deleating volume v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] get snapshots for volume v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-507058e1-f87f-484c-8ef4-e26ec08ea977 req-1e1da46a-5973-4e51-bfe0-d2c309c17050 tempest-TestStampPattern-1381824337 None] target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] get volume v_1ed186c7-3e6f-44a0-951f-c3d892647153 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1ed186c7-3e6f-44a0-951f-c3d892647153', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432502', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108130', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12169143682698859984', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ca048c3009825d95', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331328512', 'san:volume_id': 'ca048c3009825d9584356fbe887fbba4d67ab309', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78805', 'name': 'v_1ed186c7-3e6f-44a0-951f-c3d892647153', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] delete volume:v_1ed186c7-3e6f-44a0-951f-c3d892647153 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1ed186c7-3e6f-44a0-951f-c3d892647153 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] volume v_1ed186c7-3e6f-44a0-951f-c3d892647153 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.quota [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Created reservations ['dba7b717-a11b-43cc-93d7-190b5f5299aa', 'db8a3be8-a94e-45c5-8e07-c523d38625ab', 'fb19c919-8eeb-41f5-ab5b-2bf806d358a5', 'a490463c-25b3-4a3d-b4b4-e21ca3a15efe'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=66,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331398144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.manager [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:37 user cinder-volume[84560]: INFO cinder.volume.manager [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Deleted volume successfully. Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-13418f48-935c-4da1-a9a5-c24dca355086 tempest-VolumesActionsTest-1080925101 None] Lock "cinder-1ed186c7-3e6f-44a0-951f-c3d892647153-delete_volume" released by "delete_volume" :: held 3.149s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (c1456457-9a85-4c7f-b474-0b96e8a6c63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a6c323-ae42-47e6-9e1a-86274b8aebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8a6c323-ae42-47e6-9e1a-86274b8aebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808210253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f10c50e5-d369-4a75-9d74-94430fe13410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:11:38Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7329ae8c-16c0-4118-899e-eff916783801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7329ae8c-16c0-4118-899e-eff916783801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8b2e25-19e0-42bd-bbf8-975abfe03687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8b2e25-19e0-42bd-bbf8-975abfe03687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10c50e5-d369-4a75-9d74-94430fe13410', 'volume_name': 'volume-f10c50e5-d369-4a75-9d74-94430fe13410', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c071d13-ea30-4c3f-8e7a-126bf25b5ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c071d13-ea30-4c3f-8e7a-126bf25b5ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f35f41-12a9-4856-9d44-9c40c80eadb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Volume f10c50e5-d369-4a75-9d74-94430fe13410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10c50e5-d369-4a75-9d74-94430fe13410', 'volume_size': 1} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] creating volume v_f10c50e5-d369-4a75-9d74-94430fe13410. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] create volume {'name': 'v_f10c50e5-d369-4a75-9d74-94430fe13410', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f10c50e5-d369-4a75-9d74-94430fe13410', 'is_clone': False, 'name': 'v_f10c50e5-d369-4a75-9d74-94430fe13410'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3f35f41-12a9-4856-9d44-9c40c80eadb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10c50e5-d369-4a75-9d74-94430fe13410', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acac84d6-dd6f-4a4b-b1ae-cc5f226cdfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Volume volume-f10c50e5-d369-4a75-9d74-94430fe13410 (f10c50e5-d369-4a75-9d74-94430fe13410): created successfully Apr 14 00:11:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acac84d6-dd6f-4a4b-b1ae-cc5f226cdfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (c1456457-9a85-4c7f-b474-0b96e8a6c63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7e375a68-7ee4-49c3-81d6-c18ebf8f69e6 tempest-VolumesActionsTest-599923376 None] Created volume successfully. Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Acquiring lock "cinder-f10c50e5-d369-4a75-9d74-94430fe13410-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Lock "cinder-f10c50e5-d369-4a75-9d74-94430fe13410-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] remove_export for volume: f10c50e5-d369-4a75-9d74-94430fe13410. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1808210253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f10c50e5-d369-4a75-9d74-94430fe13410,launched_at=2023-04-14T00:11:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP IwngdQbt 3cqIP7Y2NL5yGf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:38Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:11:39Z,updated_at=2023-04-14T00:11:39Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] detach volume v_f10c50e5-d369-4a75-9d74-94430fe13410 from target iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410/luns/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410/luns/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410/luns/v_f10c50e5-d369-4a75-9d74-94430fe13410'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410/luns/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 because of JDSS resource v_f10c50e5-d369-4a75-9d74-94430fe13410 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] delete target: iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] delete target iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] failed to remove resource iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 because of JDSS resource iqn.2010-10.org.openstack:f10c50e5-d369-4a75-9d74-94430fe13410 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] deleating volume v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] get snapshots for volume v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] get volume v_f10c50e5-d369-4a75-9d74-94430fe13410 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f10c50e5-d369-4a75-9d74-94430fe13410', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432508', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108139', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16884566281881341260', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7b8350aece7d97ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331291648', 'san:volume_id': '7b8350aece7d97ef23c0bdc890f672c7f9e34a32', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79141', 'name': 'v_f10c50e5-d369-4a75-9d74-94430fe13410', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] delete volume:v_f10c50e5-d369-4a75-9d74-94430fe13410 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f10c50e5-d369-4a75-9d74-94430fe13410 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] volume v_f10c50e5-d369-4a75-9d74-94430fe13410 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=52,cinder:INSERT=7,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.quota [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Created reservations ['70c34930-890f-4076-ac8f-87698be770a1', '34f54615-813a-4cca-b3f7-49bf5a216d2b', '922f8fcf-50e6-4bc4-9d9f-7f01ed1ec642', 'c0f65dc6-7b31-4477-b8f5-aa736d5ca995'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331361280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.manager [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Deleted volume successfully. Apr 14 00:11:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-80d94f70-77b4-45dc-a749-82113764786a tempest-VolumesActionsTest-1080925101 None] Lock "cinder-f10c50e5-d369-4a75-9d74-94430fe13410-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (b9c70d75-474b-4655-b088-76bbcd2827e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16164fc6-f03a-4cac-93d8-69a0cff8f8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16164fc6-f03a-4cac-93d8-69a0cff8f8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2137461012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d1934b2d-0138-47ea-8c47-89b9882f9127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:11:43Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cc6da3-9495-424a-8233-b0b81b461175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cc6da3-9495-424a-8233-b0b81b461175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06f94dc-0ddf-439f-8d4e-69ecc27619da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06f94dc-0ddf-439f-8d4e-69ecc27619da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1934b2d-0138-47ea-8c47-89b9882f9127', 'volume_name': 'volume-d1934b2d-0138-47ea-8c47-89b9882f9127', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ebdea1-4f90-40dd-b3fb-6987a6a8c6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ebdea1-4f90-40dd-b3fb-6987a6a8c6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f686d07-2623-48d1-925b-155e8d070cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:42 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Volume d1934b2d-0138-47ea-8c47-89b9882f9127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1934b2d-0138-47ea-8c47-89b9882f9127', 'volume_size': 1} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] creating volume v_d1934b2d-0138-47ea-8c47-89b9882f9127. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] create volume {'name': 'v_d1934b2d-0138-47ea-8c47-89b9882f9127', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d1934b2d-0138-47ea-8c47-89b9882f9127', 'is_clone': False, 'name': 'v_d1934b2d-0138-47ea-8c47-89b9882f9127'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f686d07-2623-48d1-925b-155e8d070cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1934b2d-0138-47ea-8c47-89b9882f9127', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60679918-7549-45c8-b176-89f21a2d8fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:43 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Volume volume-d1934b2d-0138-47ea-8c47-89b9882f9127 (d1934b2d-0138-47ea-8c47-89b9882f9127): created successfully Apr 14 00:11:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60679918-7549-45c8-b176-89f21a2d8fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Flow 'volume_create_manager' (b9c70d75-474b-4655-b088-76bbcd2827e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-eaf25a5f-83ff-4391-b524-1e8a6b41f09c tempest-VolumesActionsTest-599923376 None] Created volume successfully. Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Acquiring lock "cinder-d1934b2d-0138-47ea-8c47-89b9882f9127-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Lock "cinder-d1934b2d-0138-47ea-8c47-89b9882f9127-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] remove_export for volume: d1934b2d-0138-47ea-8c47-89b9882f9127. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2137461012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d1934b2d-0138-47ea-8c47-89b9882f9127,launched_at=2023-04-14T00:11:44Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d713f06b1714ade81068ed4f9edd035',provider_auth='CHAP qPDSfeVI tIYBZ1qMXArKFT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:43Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:11:44Z,updated_at=2023-04-14T00:11:44Z,use_quota=True,user_id='f6564746aecb479c8e408df9600222cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] detach volume v_d1934b2d-0138-47ea-8c47-89b9882f9127 from target iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127/luns/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127/luns/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127/luns/v_d1934b2d-0138-47ea-8c47-89b9882f9127'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127/luns/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] failed to remove resource iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 because of JDSS resource v_d1934b2d-0138-47ea-8c47-89b9882f9127 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] delete target: iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] delete target iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] failed to remove resource iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 because of JDSS resource iqn.2010-10.org.openstack:d1934b2d-0138-47ea-8c47-89b9882f9127 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] deleating volume v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] get snapshots for volume v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] get volume v_d1934b2d-0138-47ea-8c47-89b9882f9127 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d1934b2d-0138-47ea-8c47-89b9882f9127', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432512', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108144', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5363975416740635788', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9698529d21e60186', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331291648', 'san:volume_id': '9698529d21e60186bf6eb5204b449ae6993365f0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79375', 'name': 'v_d1934b2d-0138-47ea-8c47-89b9882f9127', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] delete volume:v_d1934b2d-0138-47ea-8c47-89b9882f9127 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d1934b2d-0138-47ea-8c47-89b9882f9127 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] volume v_d1934b2d-0138-47ea-8c47-89b9882f9127 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.quota [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Created reservations ['0583e642-d011-4865-a41b-81611a991d66', 'c39bd3d9-e59e-4b09-9a14-012aae05ae3a', '2cbd8e8c-92ff-42f1-b370-7154d5426cfe', '67f6f2bb-6e79-4f43-bb73-cac9ce524036'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331373568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:47 user cinder-volume[84560]: DEBUG cinder.manager [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Deleted volume successfully. Apr 14 00:11:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-67ec9c7a-7589-4764-9f8b-1a1fa14713f4 tempest-VolumesActionsTest-599923376 None] Lock "cinder-d1934b2d-0138-47ea-8c47-89b9882f9127-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Flow 'volume_create_manager' (6a23e688-2b74-4afb-bec9-0b75d3da1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae34cf96-df6a-4ec5-aa1e-01826262eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae34cf96-df6a-4ec5-aa1e-01826262eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-974387086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7ece51b9-738f-43f2-9b4a-3234a2808795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e855b1e09b248beb6cc69af11ee793b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:11:52Z,use_quota=True,user_id='ab29c54dfe6a4645b5858ac4af1f2f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e815c07-a1ff-466c-9ea0-245d59fa7367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e815c07-a1ff-466c-9ea0-245d59fa7367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4ea0ed-3219-439a-89e7-afc2f1bf7398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c4ea0ed-3219-439a-89e7-afc2f1bf7398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ece51b9-738f-43f2-9b4a-3234a2808795', 'volume_name': 'volume-7ece51b9-738f-43f2-9b4a-3234a2808795', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad96e649-c3f2-43e7-b375-825d97856c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad96e649-c3f2-43e7-b375-825d97856c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab69b2d-25bd-4c36-8e28-509e98e5623b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Volume 7ece51b9-738f-43f2-9b4a-3234a2808795: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ece51b9-738f-43f2-9b4a-3234a2808795', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Cloning 7ece51b9-738f-43f2-9b4a-3234a2808795 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.018s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 11, 52, 427541)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 11, 52, 444080)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] create snapshot v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_7ece51b9-738f-43f2-9b4a-3234a2808795'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] create volume v_7ece51b9-738f-43f2-9b4a-3234a2808795 from snapshot v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:11:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'is_clone': True, 'full_name': 'Pool-0/v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'name': 'v_7ece51b9-738f-43f2-9b4a-3234a2808795'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] get volume v_7ece51b9-738f-43f2-9b4a-3234a2808795 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432523', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108152', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4638722971084134366', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '24f62512ebf9f71a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331336704', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79292', 'name': 'v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Marking volume 7ece51b9-738f-43f2-9b4a-3234a2808795 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 7ece51b9-738f-43f2-9b4a-3234a2808795. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Creating volume glance metadata for volume 7ece51b9-738f-43f2-9b4a-3234a2808795 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab69b2d-25bd-4c36-8e28-509e98e5623b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ece51b9-738f-43f2-9b4a-3234a2808795', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d6fe7-1436-4b1a-a771-1806ed1bff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:11:54 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Volume volume-7ece51b9-738f-43f2-9b4a-3234a2808795 (7ece51b9-738f-43f2-9b4a-3234a2808795): created successfully Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d6fe7-1436-4b1a-a771-1806ed1bff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:11:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Flow 'volume_create_manager' (6a23e688-2b74-4afb-bec9-0b75d3da1ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:11:54 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9612bc78-0bcb-4e98-9c6b-311a95dbcdf3 tempest-VolumesImageMetadata-1526154938 None] Created volume successfully. Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Acquiring lock "cinder-7ece51b9-738f-43f2-9b4a-3234a2808795-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Lock "cinder-7ece51b9-738f-43f2-9b4a-3234a2808795-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] remove_export for volume: 7ece51b9-738f-43f2-9b4a-3234a2808795. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-974387086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7ece51b9-738f-43f2-9b4a-3234a2808795,launched_at=2023-04-14T00:11:55Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e855b1e09b248beb6cc69af11ee793b',provider_auth='CHAP LTHyqrRl 9aKDPsrVpItCgY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:11:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:11:56Z,updated_at=2023-04-14T00:11:56Z,use_quota=True,user_id='ab29c54dfe6a4645b5858ac4af1f2f26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] detach volume v_7ece51b9-738f-43f2-9b4a-3234a2808795 from target iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795/luns/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795/luns/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795/luns/v_7ece51b9-738f-43f2-9b4a-3234a2808795'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795/luns/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] failed to remove resource iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 because of JDSS resource v_7ece51b9-738f-43f2-9b4a-3234a2808795 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] delete target: iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] delete target iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] failed to remove resource iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 because of JDSS resource iqn.2010-10.org.openstack:7ece51b9-738f-43f2-9b4a-3234a2808795 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] deleating volume v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] get snapshots for volume v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] get volume v_7ece51b9-738f-43f2-9b4a-3234a2808795 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432523', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108152', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4638722971084134366', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '24f62512ebf9f71a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331324416', 'san:volume_id': '24f62512ebf9f71aac83888371e266e00e7b2723', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79292', 'name': 'v_7ece51b9-738f-43f2-9b4a-3234a2808795', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] delete snapshot v_7ece51b9-738f-43f2-9b4a-3234a2808795 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] terminate connection for 49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:11:57 user cinder-volume[84560]: INFO cinder.volume.manager [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Deleting attachment a341bb68-6a2f-4266-9e1c-92874d4bb63a. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-427589178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49172d5a-2944-486a-a080-04548e55ac0d,launched_at=2023-04-14T00:08:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP mpSjLhaD kHcvwSOuQGKYJI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:11:55Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] detach volume v_49172d5a-2944-486a-a080-04548e55ac0d from target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d826eff7-76b0-4e5c-af3e-6af0bbebd504 req-6dc41d73-5ab0-4575-929c-bb01aab74c7d tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_7ece51b9-738f-43f2-9b4a-3234a2808795 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] snapshot v_7ece51b9-738f-43f2-9b4a-3234a2808795 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=27,cinder:SELECT=64,cinder:DELETE=2,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.quota [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Created reservations ['f88378a4-8b55-4fcc-876e-14f49dcd6ce6', '360a8988-0ee2-4fb5-a5b4-d2e93acc71f7', 'f0fc04f6-e673-44b2-8dad-23db2c489d88', 'b9618e8e-812a-4b73-ad89-c5a16c24c86e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=51,cinder:INSERT=15,cinder:UPDATE=31,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331373568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.manager [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:11:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Deleted volume successfully. Apr 14 00:11:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-650e2d4f-c91b-4e06-8124-25ae6f36802b tempest-VolumesImageMetadata-1526154938 None] Lock "cinder-7ece51b9-738f-43f2-9b4a-3234a2808795-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Acquiring lock "cinder-028eff5c-aa61-4243-985e-5210aedff04a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Lock "cinder-028eff5c-aa61-4243-985e-5210aedff04a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] remove_export for volume: 028eff5c-aa61-4243-985e-5210aedff04a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerStableDeviceRescueTest-volume-811798238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=028eff5c-aa61-4243-985e-5210aedff04a,launched_at=2023-04-14T00:08:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c931198e56de4cf08db59bcc40f2a260',provider_auth='CHAP iVbjylRT oIuhxkLTlzeYDO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:12:06Z,updated_at=2023-04-14T00:12:07Z,use_quota=True,user_id='97374cd3cdc448cd8710561d44756ead',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] detach volume v_028eff5c-aa61-4243-985e-5210aedff04a from target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a/luns/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] failed to remove resource iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a because of JDSS resource v_028eff5c-aa61-4243-985e-5210aedff04a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] delete target: iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] delete target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] failed to remove resource iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a because of JDSS resource iqn.2010-10.org.openstack:028eff5c-aa61-4243-985e-5210aedff04a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] deleating volume v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] get snapshots for volume v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] get volume v_028eff5c-aa61-4243-985e-5210aedff04a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_028eff5c-aa61-4243-985e-5210aedff04a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432330', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108000', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11513061499864443473', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '919610d61be62a32', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331373568', 'san:volume_id': '919610d61be62a32e2d91a4ce558d1635cfbb961', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79364', 'name': 'v_028eff5c-aa61-4243-985e-5210aedff04a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] delete volume:v_028eff5c-aa61-4243-985e-5210aedff04a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_028eff5c-aa61-4243-985e-5210aedff04a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] volume v_028eff5c-aa61-4243-985e-5210aedff04a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.quota [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Created reservations ['a8904ae2-565f-4b22-9021-1d2d53a21095', 'e4148d83-a001-4c80-92a5-70eae2e226a1', 'b2c3b7e0-e678-43f8-a8fa-a03b652c52b0', '0ebe097b-6106-4afa-98ef-32d510c4ff3d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331455488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.manager [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:12:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Deleted volume successfully. Apr 14 00:12:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-88299108-b5df-40d9-a192-324ae5c6906b tempest-ServerStableDeviceRescueTest-481368698 None] Lock "cinder-028eff5c-aa61-4243-985e-5210aedff04a-delete_volume" released by "delete_volume" :: held 3.322s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] terminate connection for 215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:12:12 user cinder-volume[84560]: INFO cinder.volume.manager [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Terminate volume connection completed successfully. Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Deleting attachment b4b24ae2-8900-4476-bc99-6ab4831f3406. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove_export for volume: 215fee6a-a733-4408-a162-1e700d5bf7fc. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-281782003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=215fee6a-a733-4408-a162-1e700d5bf7fc,launched_at=2023-04-14T00:10:01Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth='CHAP jPSrRZvK kZpqdPgMwSj8CV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:00Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:10:32Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume v_215fee6a-a733-4408-a162-1e700d5bf7fc from target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] terminate connection for 43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:12:12 user cinder-volume[84560]: INFO cinder.volume.manager [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Terminate volume connection completed successfully. Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Deleting attachment 68c09242-06d5-4c79-9e23-2274dceabfd1. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] remove_export for volume: 43ba2057-0822-4741-b91d-718067f21593. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1511182728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=43ba2057-0822-4741-b91d-718067f21593,launched_at=2023-04-14T00:09:14Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth='CHAP dNQGcVbh CnDNO2fKFLzpQ5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:13Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:12:12Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] detach volume v_43ba2057-0822-4741-b91d-718067f21593 from target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] delete target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] delete target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-e7d72ce3-53eb-49d7-a1b7-1a413b698956 tempest-TaggedBootDevicesTest_v242-1295697559 None] target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] terminate connection for 70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:12:13 user cinder-volume[84560]: INFO cinder.volume.manager [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Terminate volume connection completed successfully. Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Deleting attachment c3f8ef01-a91c-46c3-b28f-664c6a038a53. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] remove_export for volume: 70173bca-df37-41ee-adcb-1e0464d96d62. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1330232612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=70173bca-df37-41ee-adcb-1e0464d96d62,launched_at=2023-04-14T00:09:57Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth='CHAP XKCdSwHe TYcZl9MARy1XUN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:55Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:10:20Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume v_70173bca-df37-41ee-adcb-1e0464d96d62 from target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8ab51440-d973-4b6d-bc05-c5f0dbea64af req-ab14d4ed-5ecb-4eab-b3a9-6ebf7efda285 tempest-AttachVolumeNegativeTest-719597397 None] target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-ae474281-5d7a-46c9-a1ac-71b2f4440efa tempest-TaggedBootDevicesTest_v242-1295697559 None] target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] terminate connection for 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:12:14 user cinder-volume[84560]: INFO cinder.volume.manager [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Terminate volume connection completed successfully. Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Deleting attachment db90ce2b-b052-4826-bd61-45ecc34ca9f8. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove_export for volume: 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-902201793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94fa4f60-6d5e-4c7b-b5a6-0923600a26e0,launched_at=2023-04-14T00:09:59Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth='CHAP KBCYoGZf NERgpLqSZOFn6b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:58Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:10:25Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 from target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-80790372-ac22-443b-aedf-380c1684705d req-b64de5c7-92d3-4838-969b-a213ebcf8fe2 tempest-TaggedBootDevicesTest_v242-1295697559 None] target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331455488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:12:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:12:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=26,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=31,cinder:INSERT=4,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Acquiring lock "cinder-215fee6a-a733-4408-a162-1e700d5bf7fc-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-215fee6a-a733-4408-a162-1e700d5bf7fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove_export for volume: 215fee6a-a733-4408-a162-1e700d5bf7fc. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-281782003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=215fee6a-a733-4408-a162-1e700d5bf7fc,launched_at=2023-04-14T00:10:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth='CHAP jPSrRZvK kZpqdPgMwSj8CV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:00Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:12:59Z,updated_at=2023-04-14T00:12:59Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume v_215fee6a-a733-4408-a162-1e700d5bf7fc from target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc/luns/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] failed to remove resource iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc because of JDSS resource v_215fee6a-a733-4408-a162-1e700d5bf7fc DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target: iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] failed to remove resource iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc because of JDSS resource iqn.2010-10.org.openstack:215fee6a-a733-4408-a162-1e700d5bf7fc DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] deleating volume v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] get snapshots for volume v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] get volume v_215fee6a-a733-4408-a162-1e700d5bf7fc info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_215fee6a-a733-4408-a162-1e700d5bf7fc', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432409', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108072', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1769482779809276745', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '84560b9e7982ccc4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331455488', 'san:volume_id': '84560b9e7982ccc45ad388d634b25b7f7cfcc5a7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '77423', 'name': 'v_215fee6a-a733-4408-a162-1e700d5bf7fc', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete volume:v_215fee6a-a733-4408-a162-1e700d5bf7fc recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:12:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_215fee6a-a733-4408-a162-1e700d5bf7fc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] volume v_215fee6a-a733-4408-a162-1e700d5bf7fc deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.quota [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Created reservations ['473cb825-fcd8-4326-a041-c7e4a32c0bc3', '09326e84-bd0c-4ca5-bf4d-4f07041469f4', '03ff0357-88fb-463e-9449-bee9c4e2d7a4', '573d4ecd-ed63-4947-a114-45cad351ab32'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331537408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.manager [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Deleted volume successfully. Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-419252e0-1dcd-4563-bb82-315f29245b02 tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-215fee6a-a733-4408-a162-1e700d5bf7fc-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Acquiring lock "cinder-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] remove_export for volume: 94fa4f60-6d5e-4c7b-b5a6-0923600a26e0. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-902201793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94fa4f60-6d5e-4c7b-b5a6-0923600a26e0,launched_at=2023-04-14T00:09:59Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth='CHAP KBCYoGZf NERgpLqSZOFn6b',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:58Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:13:02Z,updated_at=2023-04-14T00:13:02Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 from target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/luns/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] failed to remove resource iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 because of JDSS resource v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target: iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] failed to remove resource iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 because of JDSS resource iqn.2010-10.org.openstack:94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] deleating volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] get snapshots for volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] get volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432408', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108068', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15131408123585455282', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b6409aff2f46b628', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331537408', 'san:volume_id': 'b6409aff2f46b628b2622209d22fa924135a4222', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78524', 'name': 'v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] delete volume:v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] volume v_94fa4f60-6d5e-4c7b-b5a6-0923600a26e0 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.quota [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Created reservations ['7fe27f9b-1e69-4963-b387-ad9145dba9c1', '8580352c-7d20-451d-911e-16b65f61f7ef', '6bd65520-c973-4769-b702-4cc7ed543c67', '1be82039-98f9-4f07-8898-daf5c7270575'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331631616', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.manager [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:05 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Deleted volume successfully. Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a6152668-b7cb-450f-8c5b-94de2bb6a42e tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-94fa4f60-6d5e-4c7b-b5a6-0923600a26e0-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Acquiring lock "cinder-70173bca-df37-41ee-adcb-1e0464d96d62-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-70173bca-df37-41ee-adcb-1e0464d96d62-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=31,cinder:UPDATE=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove_export for volume: 70173bca-df37-41ee-adcb-1e0464d96d62. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-1330232612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=70173bca-df37-41ee-adcb-1e0464d96d62,launched_at=2023-04-14T00:09:57Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be44ce9922f14c6fa75dc0f99b544851',provider_auth='CHAP XKCdSwHe TYcZl9MARy1XUN',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:55Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:13:06Z,updated_at=2023-04-14T00:13:06Z,use_quota=True,user_id='85f2e1744d6c460a81c97f39a76ef5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] detach volume v_70173bca-df37-41ee-adcb-1e0464d96d62 from target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62/luns/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] failed to remove resource iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 because of JDSS resource v_70173bca-df37-41ee-adcb-1e0464d96d62 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target: iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] failed to remove resource iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 because of JDSS resource iqn.2010-10.org.openstack:70173bca-df37-41ee-adcb-1e0464d96d62 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] deleating volume v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] get snapshots for volume v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] get volume v_70173bca-df37-41ee-adcb-1e0464d96d62 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_70173bca-df37-41ee-adcb-1e0464d96d62', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_70173bca-df37-41ee-adcb-1e0464d96d62', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432406', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '108064', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3682031358069928580', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '37b4a7e3f235839e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331631616', 'san:volume_id': '37b4a7e3f235839e8d4c8f68bf4a46a324adbc7d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '78689', 'name': 'v_70173bca-df37-41ee-adcb-1e0464d96d62', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] delete snapshot v_70173bca-df37-41ee-adcb-1e0464d96d62 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_70173bca-df37-41ee-adcb-1e0464d96d62 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] snapshot v_70173bca-df37-41ee-adcb-1e0464d96d62 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.quota [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Created reservations ['789ee98f-abd5-4051-a9a1-c458776b6dfc', '43746031-482d-4b9c-844e-46486488fec6', 'abd1a195-c966-4d09-9d5a-6a8b2e4c4301', '9ea1bb19-070b-4332-a378-0c2f9765f1ea'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341822464', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:08 user cinder-volume[84560]: DEBUG cinder.manager [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:08 user cinder-volume[84560]: INFO cinder.volume.manager [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Deleted volume successfully. Apr 14 00:13:08 user cinder-volume[84560]: DEBUG cinder.coordination [None req-629f5f32-d56b-4cca-a3cc-7e1cbcca17c8 tempest-TaggedBootDevicesTest_v242-1295697559 None] Lock "cinder-70173bca-df37-41ee-adcb-1e0464d96d62-delete_volume" released by "delete_volume" :: held 2.834s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Acquiring lock "cinder-9a4ad5f1-58f1-4934-b18f-9890ae47ecde-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Lock "cinder-9a4ad5f1-58f1-4934-b18f-9890ae47ecde-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] remove_export for volume: 9a4ad5f1-58f1-4934-b18f-9890ae47ecde. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-4928667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9a4ad5f1-58f1-4934-b18f-9890ae47ecde,launched_at=2023-04-14T00:09:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f138770c7b4407d83c449500fc000a5',provider_auth='CHAP PTrqskZW YuePStWclkoE8j',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:27Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=9f451298-7f42-4338-8b9f-45b9729f491e,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:13:14Z,updated_at=2023-04-14T00:13:14Z,use_quota=True,user_id='6fe75acb64a94a2a88d370f43fa6b776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] detach volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde from target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde/luns/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] failed to remove resource iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde because of JDSS resource v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] delete target: iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] delete target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] failed to remove resource iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde because of JDSS resource iqn.2010-10.org.openstack:9a4ad5f1-58f1-4934-b18f-9890ae47ecde DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] deleating volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] get snapshots for volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] get volume v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_9f451298-7f42-4338-8b9f-45b9729f491e@v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432377', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '108052', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3195293523390249393', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '90112', 'logicalused': '303104', 'compressratio': '6.16', 'rootcontext': 'none', 'default_scsi_id': 'e672f3930cdcb135', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341822464', 'san:volume_id': 'e672f3930cdcb135649433a9502cd9b8f67a933a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '90112', 'objsetid': '78787', 'name': 'v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '90112', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] delete snapshot v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde of volume s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Flow 'volume_create_manager' (614221a0-4a72-4893-b497-0b5bbc319ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907daaf6-7bb8-4eb0-a164-ab7f8bf99869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907daaf6-7bb8-4eb0-a164-ab7f8bf99869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711029289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cafbda8-d881-4ce4-b77f-a22e606d9ac9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e9bf71f0644907979ec775c62a0b39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:13:15Z,use_quota=True,user_id='719f2342cc1d452daae3a4ded790f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb8a18c-705f-484c-b568-cc487a28abc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fb8a18c-705f-484c-b568-cc487a28abc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3c8455-37ad-4b5d-afb6-8039810518d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b3c8455-37ad-4b5d-afb6-8039810518d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'volume_name': 'volume-6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cc9295-e300-46e2-857a-0c8042766ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cc9295-e300-46e2-857a-0c8042766ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00caebc-f1ad-484b-8de3-e8fee6633f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:15 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'volume_size': 1} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] creating volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] create volume {'name': 'v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots/v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] snapshot v_9a4ad5f1-58f1-4934-b18f-9890ae47ecde deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.quota [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Created reservations ['b281cee3-ca3a-4e34-bc03-2238f50bc2d6', '8df6af02-89c3-4e05-b6cc-6b6576ae1d2a', '1bbebdfd-0362-4643-9dfb-cf036249dc58', 'db71bbc4-5b7a-4942-b31d-67fe71c5737d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'is_clone': False, 'name': 'v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00caebc-f1ad-484b-8de3-e8fee6633f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45bc0c3-3e35-41ec-8b44-851dc6c783fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:17 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Volume volume-6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (6cafbda8-d881-4ce4-b77f-a22e606d9ac9): created successfully Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c45bc0c3-3e35-41ec-8b44-851dc6c783fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Flow 'volume_create_manager' (614221a0-4a72-4893-b497-0b5bbc319ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:17 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cb7a0270-70ec-498b-a896-925044f9034e tempest-VolumesActionsTest-422643142 None] Created volume successfully. Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Acquiring lock "cinder-9f451298-7f42-4338-8b9f-45b9729f491e-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Lock "cinder-9f451298-7f42-4338-8b9f-45b9729f491e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] deleating snapshot s_9f451298-7f42-4338-8b9f-45b9729f491e. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] get snapshots for volume s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341879808', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.manager [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:18 user cinder-volume[84560]: INFO cinder.volume.manager [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Deleted volume successfully. Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.coordination [None req-565e4329-5114-4e08-8f66-e51db56c51a4 tempest-TestStampPattern-1381824337 None] Lock "cinder-9a4ad5f1-58f1-4934-b18f-9890ae47ecde-delete_volume" released by "delete_volume" :: held 3.643s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] get volume s_9f451298-7f42-4338-8b9f-45b9729f491e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3@s_9f451298-7f42-4338-8b9f-45b9729f491e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_9f451298-7f42-4338-8b9f-45b9729f491e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432366', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '108041', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15702003489563173453', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f0431dfcefaeab1f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341879808', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '78664', 'name': 's_9f451298-7f42-4338-8b9f-45b9729f491e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] delete snapshot s_9f451298-7f42-4338-8b9f-45b9729f491e of volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots/s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots/s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots/s_9f451298-7f42-4338-8b9f-45b9729f491e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] snapshot s_9f451298-7f42-4338-8b9f-45b9729f491e deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:13:20 user cinder-volume[84560]: DEBUG cinder.quota [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Created reservations ['77dfdbef-397c-4924-b9bc-d93057f2c075', '2dee458f-cff1-4ea5-bda8-4bf6ae490825', '5e07d176-9bf5-47c6-af9e-680ae50c92f0', '6d56f060-025e-42bf-82cb-ca42858271e1'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Delete snapshot completed successfully. Apr 14 00:13:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f5799b87-8cef-4e1d-99a9-744dc01cab87 tempest-TestStampPattern-1381824337 None] Lock "cinder-9f451298-7f42-4338-8b9f-45b9729f491e-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:13:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9b5e5953-67ba-41b8-859f-864badf6a8d7 tempest-GroupsV314Test-1688132872 None] Group tempest-GroupsV314Test-Group-1893086484: creating Apr 14 00:13:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9b5e5953-67ba-41b8-859f-864badf6a8d7 tempest-GroupsV314Test-1688132872 None] Group tempest-GroupsV314Test-Group-1893086484: created successfully Apr 14 00:13:20 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9b5e5953-67ba-41b8-859f-864badf6a8d7 tempest-GroupsV314Test-1688132872 None] Create group completed successfully. Apr 14 00:13:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:13:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114341924864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Flow 'volume_create_manager' (5a6bd723-49d2-431b-9329-5c15b01f0a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b9f9c2-307d-45ab-aa14-cb68d96ee956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b9f9c2-307d-45ab-aa14-cb68d96ee956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227052216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9715cdb3-d1ee-46c1-9160-9327d3b8374b,host='user@joviandss-2#joviandss-2',id=652a1795-782b-4095-bd17-5b2315cdb1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a449aefea940dc9aad820a12d69e66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:13:22Z,use_quota=True,user_id='510f8a7e2dab4fb1862b9a7160b687dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8e2605-2174-44ba-9432-3ff73c811047),volume_type_id=fa8e2605-2174-44ba-9432-3ff73c811047)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c58ad8-591b-49e1-a64a-ad9c57bba917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c58ad8-591b-49e1-a64a-ad9c57bba917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928e0061-75ae-4afa-9138-f91810531c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928e0061-75ae-4afa-9138-f91810531c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652a1795-782b-4095-bd17-5b2315cdb1d8', 'volume_name': 'volume-652a1795-782b-4095-bd17-5b2315cdb1d8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcce3d7-3fe2-4f61-9aec-d5fedb5d3e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcce3d7-3fe2-4f61-9aec-d5fedb5d3e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f7665f-6b42-4237-9020-10bcbda2e3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:22 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Volume 652a1795-782b-4095-bd17-5b2315cdb1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652a1795-782b-4095-bd17-5b2315cdb1d8', 'volume_size': 1} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] creating volume v_652a1795-782b-4095-bd17-5b2315cdb1d8. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] create volume {'name': 'v_652a1795-782b-4095-bd17-5b2315cdb1d8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_652a1795-782b-4095-bd17-5b2315cdb1d8', 'is_clone': False, 'name': 'v_652a1795-782b-4095-bd17-5b2315cdb1d8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f7665f-6b42-4237-9020-10bcbda2e3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652a1795-782b-4095-bd17-5b2315cdb1d8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b977f80-6c5b-41e7-a133-a3938fdc6709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:23 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Volume volume-652a1795-782b-4095-bd17-5b2315cdb1d8 (652a1795-782b-4095-bd17-5b2315cdb1d8): created successfully Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b977f80-6c5b-41e7-a133-a3938fdc6709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Flow 'volume_create_manager' (5a6bd723-49d2-431b-9329-5c15b01f0a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:23 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b4c36b62-1398-432e-8330-01b4083a5e28 tempest-GroupsV314Test-1688132872 None] Created volume successfully. Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] cloned volume 652a1795-782b-4095-bd17-5b2315cdb1d8 to c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] cloning v_652a1795-782b-4095-bd17-5b2315cdb1d8 to v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] create snapshot v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] create volume v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 from snapshot v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:13:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_652a1795-782b-4095-bd17-5b2315cdb1d8@v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'is_clone': True, 'full_name': 'Pool-0/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'name': 'v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] get volume v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_652a1795-782b-4095-bd17-5b2315cdb1d8@v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432614', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108197', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '81445412458641252', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1b8d3ea63dffd5ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341842944', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79633', 'name': 'v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:25 user cinder-volume[84560]: INFO cinder.volume.manager [None req-80ba03ad-a4de-4933-8f3e-71252c665a3d tempest-GroupsV314Test-1688132872 None] Create group from source-group-9715cdb3-d1ee-46c1-9160-9327d3b8374b completed successfully. Apr 14 00:13:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=62,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] remove_export for volume: c8627bf8-2da3-40be-8398-ac6a4ce4cda7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50d4f1e6-4125-4ad7-ad8d-a38d3b0fc3ba,host='user@joviandss-2#joviandss-2',id=c8627bf8-2da3-40be-8398-ac6a4ce4cda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a449aefea940dc9aad820a12d69e66',provider_auth='CHAP vBcdRWQE dGn9mD3SvthQoR',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=None,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=652a1795-782b-4095-bd17-5b2315cdb1d8,status='deleting',terminated_at=None,updated_at=2023-04-14T00:13:27Z,use_quota=True,user_id='510f8a7e2dab4fb1862b9a7160b687dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8e2605-2174-44ba-9432-3ff73c811047),volume_type_id=fa8e2605-2174-44ba-9432-3ff73c811047) from target:iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] detach volume v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 from target iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7/luns/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7/luns/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7/luns/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7/luns/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] failed to remove resource iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 because of JDSS resource v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] delete target: iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] delete target iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] failed to remove resource iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 because of JDSS resource iqn.2010-10.org.openstack:c8627bf8-2da3-40be-8398-ac6a4ce4cda7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] deleating volume v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] get snapshots for volume v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] get volume v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_652a1795-782b-4095-bd17-5b2315cdb1d8@v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432614', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108197', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '81445412458641252', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '1b8d3ea63dffd5ef', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341830656', 'san:volume_id': '1b8d3ea63dffd5efe6e75ad7785380004684ad8c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79633', 'name': 'v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] delete snapshot v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 of volume v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots/v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] snapshot v_c8627bf8-2da3-40be-8398-ac6a4ce4cda7 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=62,cinder:INSERT=6,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.quota [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Created reservations ['74afb917-58fb-4289-a663-a576d40a6341'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:28 user cinder-volume[84560]: WARNING cinder.quota [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-731198955 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-731198955, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:13:28 user cinder-volume[84560]: WARNING cinder.quota [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-731198955 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-731198955, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.quota [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Created reservations ['bc9cca12-8f12-4531-bcc0-d19574b0dc6c', '6e7df4ef-5d37-4220-bd26-bb4ec438096f', '93af9a7b-f185-4182-b9da-90c59fe7830d', '86d52928-e13f-467c-bb0f-ee191ec5ec9e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] remove_export for volume: 652a1795-782b-4095-bd17-5b2315cdb1d8. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-227052216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9715cdb3-d1ee-46c1-9160-9327d3b8374b,host='user@joviandss-2#joviandss-2',id=652a1795-782b-4095-bd17-5b2315cdb1d8,launched_at=2023-04-14T00:13:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a449aefea940dc9aad820a12d69e66',provider_auth='CHAP JYRlAXux QJg3TchDsA7yNz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:22Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:13:29Z,use_quota=True,user_id='510f8a7e2dab4fb1862b9a7160b687dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa8e2605-2174-44ba-9432-3ff73c811047),volume_type_id=fa8e2605-2174-44ba-9432-3ff73c811047) from target:iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] detach volume v_652a1795-782b-4095-bd17-5b2315cdb1d8 from target iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8/luns/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8/luns/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8/luns/v_652a1795-782b-4095-bd17-5b2315cdb1d8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8/luns/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] failed to remove resource iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 because of JDSS resource v_652a1795-782b-4095-bd17-5b2315cdb1d8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] delete target: iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] delete target iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] failed to remove resource iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 because of JDSS resource iqn.2010-10.org.openstack:652a1795-782b-4095-bd17-5b2315cdb1d8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] deleating volume v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] get snapshots for volume v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341867520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.manager [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-76da465a-f6df-47c0-8067-960f94fbc8d9 tempest-GroupsV314Test-1688132872 None] Delete group completed successfully. Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] get volume v_652a1795-782b-4095-bd17-5b2315cdb1d8 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_652a1795-782b-4095-bd17-5b2315cdb1d8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432612', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108191', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5201349494051195384', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6411cf65b165917f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341867520', 'san:volume_id': '6411cf65b165917f4a82674ca9b8bfeaf0da2d9a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79620', 'name': 'v_652a1795-782b-4095-bd17-5b2315cdb1d8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] delete volume:v_652a1795-782b-4095-bd17-5b2315cdb1d8 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_652a1795-782b-4095-bd17-5b2315cdb1d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] volume v_652a1795-782b-4095-bd17-5b2315cdb1d8 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.quota [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Created reservations ['13a7221d-36c6-48b8-b544-3d8af3b8b179'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.quota [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Created reservations ['33104e57-ae3a-4e4c-a93c-1fd1e939765f', '9886a788-fce7-4cf5-ad11-cb4b8064c82e', '51cab8e6-98b2-454e-981e-15253e54f473', 'b367e2e1-5013-4efa-81be-624b62a9e970'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341949440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:32 user cinder-volume[84560]: DEBUG cinder.manager [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:32 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cf40f2bc-295a-4af0-b4b8-28b58cafdb1a tempest-GroupsV314Test-1688132872 None] Delete group completed successfully. Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Flow 'volume_create_manager' (ac123c4d-e3bf-487c-b05e-378a0a3ba889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e3ec2-638f-4420-b7e9-4473e09890bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e3ec2-638f-4420-b7e9-4473e09890bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1279491513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4270bff4-1d2a-4b37-8624-ee675fa9061d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffbe999e60a4add9f23c83f9b0a4252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:13:35Z,use_quota=True,user_id='74d7e3d598e74c288e6a44996303b85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a527c9-d370-4eba-b571-89d81a8410de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1a527c9-d370-4eba-b571-89d81a8410de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d74951-56bb-46d1-9db8-c719e5be917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d74951-56bb-46d1-9db8-c719e5be917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4270bff4-1d2a-4b37-8624-ee675fa9061d', 'volume_name': 'volume-4270bff4-1d2a-4b37-8624-ee675fa9061d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e095490-d612-405f-b838-ff660b9c9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e095490-d612-405f-b838-ff660b9c9492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2928009-9d6e-4677-bfb8-bbc27fa2fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Volume 4270bff4-1d2a-4b37-8624-ee675fa9061d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4270bff4-1d2a-4b37-8624-ee675fa9061d', 'volume_size': 1} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] creating volume v_4270bff4-1d2a-4b37-8624-ee675fa9061d. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] create volume {'name': 'v_4270bff4-1d2a-4b37-8624-ee675fa9061d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Flow 'volume_create_manager' (f07aaf5e-ece0-4f8f-964f-7b58ffd2b44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932adfa6-9064-41b8-986b-77d22c15ae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932adfa6-9064-41b8-986b-77d22c15ae0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1206800891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fab467fd-34da-43fc-9994-5bc67d32a8f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d27c26e8e4b529040d8909aec1a04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:13:36Z,use_quota=True,user_id='bb07ce4305014dfaacd6283e4fcab068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c76b44d-bc5b-49ef-8a08-76fde29c0311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c76b44d-bc5b-49ef-8a08-76fde29c0311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8164da1-4cc6-4a22-a06b-6db0daaf25d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8164da1-4cc6-4a22-a06b-6db0daaf25d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fab467fd-34da-43fc-9994-5bc67d32a8f8', 'volume_name': 'volume-fab467fd-34da-43fc-9994-5bc67d32a8f8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a4e5e1-cdd4-4ad7-a985-15b0cce9d67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3a4e5e1-cdd4-4ad7-a985-15b0cce9d67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4772e8-c343-4ba3-b28b-54523b291c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:35 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Volume fab467fd-34da-43fc-9994-5bc67d32a8f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fab467fd-34da-43fc-9994-5bc67d32a8f8', 'volume_size': 1} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] creating volume v_fab467fd-34da-43fc-9994-5bc67d32a8f8. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] create volume {'name': 'v_fab467fd-34da-43fc-9994-5bc67d32a8f8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4270bff4-1d2a-4b37-8624-ee675fa9061d', 'is_clone': False, 'name': 'v_4270bff4-1d2a-4b37-8624-ee675fa9061d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2928009-9d6e-4677-bfb8-bbc27fa2fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4270bff4-1d2a-4b37-8624-ee675fa9061d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da64b78f-04c9-4c93-b672-90902a4b115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:36 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Volume volume-4270bff4-1d2a-4b37-8624-ee675fa9061d (4270bff4-1d2a-4b37-8624-ee675fa9061d): created successfully Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da64b78f-04c9-4c93-b672-90902a4b115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Flow 'volume_create_manager' (ac123c4d-e3bf-487c-b05e-378a0a3ba889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2049e0a6-5af4-4f04-a41b-3a5fc01070f3 tempest-VolumesAdminNegativeTest-1377720460 None] Created volume successfully. Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fab467fd-34da-43fc-9994-5bc67d32a8f8', 'is_clone': False, 'name': 'v_fab467fd-34da-43fc-9994-5bc67d32a8f8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4772e8-c343-4ba3-b28b-54523b291c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fab467fd-34da-43fc-9994-5bc67d32a8f8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d37e284-f7f2-4014-b1cf-13364722d149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:36 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Volume volume-fab467fd-34da-43fc-9994-5bc67d32a8f8 (fab467fd-34da-43fc-9994-5bc67d32a8f8): created successfully Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d37e284-f7f2-4014-b1cf-13364722d149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Flow 'volume_create_manager' (f07aaf5e-ece0-4f8f-964f-7b58ffd2b44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9c72e844-dd32-4d14-a047-46e2b1b3564b tempest-VolumesNegativeTest-1085100121 None] Created volume successfully. Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Acquiring lock "cinder-4270bff4-1d2a-4b37-8624-ee675fa9061d-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Lock "cinder-4270bff4-1d2a-4b37-8624-ee675fa9061d-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] remove_export for volume: 4270bff4-1d2a-4b37-8624-ee675fa9061d. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1279491513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4270bff4-1d2a-4b37-8624-ee675fa9061d,launched_at=2023-04-14T00:13:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffbe999e60a4add9f23c83f9b0a4252',provider_auth='CHAP UyagjHru nwx2NCJXYDQr9y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:35Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:13:38Z,updated_at=2023-04-14T00:13:38Z,use_quota=True,user_id='74d7e3d598e74c288e6a44996303b85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] detach volume v_4270bff4-1d2a-4b37-8624-ee675fa9061d from target iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d/luns/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d/luns/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d/luns/v_4270bff4-1d2a-4b37-8624-ee675fa9061d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d/luns/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] failed to remove resource iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d because of JDSS resource v_4270bff4-1d2a-4b37-8624-ee675fa9061d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] delete target: iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] delete target iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] failed to remove resource iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d because of JDSS resource iqn.2010-10.org.openstack:4270bff4-1d2a-4b37-8624-ee675fa9061d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] deleating volume v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] get snapshots for volume v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] get volume v_4270bff4-1d2a-4b37-8624-ee675fa9061d info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4270bff4-1d2a-4b37-8624-ee675fa9061d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432625', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108206', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7736873094005145290', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4c6b48f6636b1f27', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341773312', 'san:volume_id': '4c6b48f6636b1f27c15c30903d93cedbe75ded2c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79652', 'name': 'v_4270bff4-1d2a-4b37-8624-ee675fa9061d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] delete volume:v_4270bff4-1d2a-4b37-8624-ee675fa9061d recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4270bff4-1d2a-4b37-8624-ee675fa9061d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] volume v_4270bff4-1d2a-4b37-8624-ee675fa9061d deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.quota [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Created reservations ['98adb0a7-e029-4a7d-8b23-3c03881f97d2', '658e4a2d-4b7d-493e-a90d-b3c1e081ec84', '5b925d70-d53d-445e-9e69-045164624c53', '37173d67-fa1e-41c8-92dc-f693052fc3c5'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341855232', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:13:40 user cinder-volume[84560]: DEBUG cinder.manager [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:13:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Deleted volume successfully. Apr 14 00:13:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06969bc5-b098-49d9-8d8a-82d47ebe64e9 tempest-VolumesAdminNegativeTest-1377720460 None] Lock "cinder-4270bff4-1d2a-4b37-8624-ee675fa9061d-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:13:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=57,cinder:UPDATE=37,cinder:INSERT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Flow 'volume_create_manager' (72ec900b-985d-4fea-97aa-6316ec46bc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d012fdf7-6e5e-4d2e-b78f-f4c989ef0337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d012fdf7-6e5e-4d2e-b78f-f4c989ef0337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1167118353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94d1d134-5857-4a7c-bf52-bd818e828f3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:13:47Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8609e0-9093-4fad-af6c-ba90c014f002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8609e0-9093-4fad-af6c-ba90c014f002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948d0d19-9ca7-44ab-b4b4-d514732c801f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (948d0d19-9ca7-44ab-b4b4-d514732c801f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94d1d134-5857-4a7c-bf52-bd818e828f3e', 'volume_name': 'volume-94d1d134-5857-4a7c-bf52-bd818e828f3e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1d01da-6ef8-4cf3-866d-9ac4fa756ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1d01da-6ef8-4cf3-866d-9ac4fa756ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2fd8fb-e37c-49fe-9da1-f47365acd7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:47 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Volume 94d1d134-5857-4a7c-bf52-bd818e828f3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94d1d134-5857-4a7c-bf52-bd818e828f3e', 'volume_size': 1} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] creating volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] create volume {'name': 'v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'is_clone': False, 'name': 'v_94d1d134-5857-4a7c-bf52-bd818e828f3e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2fd8fb-e37c-49fe-9da1-f47365acd7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d1d134-5857-4a7c-bf52-bd818e828f3e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e7d56-d3a5-4b82-a58c-41cc7d0f585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:13:48 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Volume volume-94d1d134-5857-4a7c-bf52-bd818e828f3e (94d1d134-5857-4a7c-bf52-bd818e828f3e): created successfully Apr 14 00:13:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694e7d56-d3a5-4b82-a58c-41cc7d0f585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:13:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Flow 'volume_create_manager' (72ec900b-985d-4fea-97aa-6316ec46bc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:13:48 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=57,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:13:48 user cinder-volume[84560]: INFO cinder.volume.manager [None req-394075ad-0066-40b1-b6cd-15160647cc5c tempest-ServerActionsTestJSON-948553482 None] Created volume successfully. Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] create export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] ensure volume 94d1d134-5857-4a7c-bf52-bd818e828f3e assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 94d1d134-5857-4a7c-bf52-bd818e828f3e to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] atach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e to target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:13:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3363343733396464', 'lun': 0, 'mode': 'wt', 'name': 'v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'prod_id': 'Storage', 'scsi_id': '3c4739dd0c0e6c33'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YrRJCHcL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 94d1d134-5857-4a7c-bf52-bd818e828f3e 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:13:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '53719744-a818-4d6a-ad68-ce4423c988fb'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:13:54 user cinder-volume[84560]: INFO cinder.volume.manager [req-58c53a43-b0ff-4274-bc9a-8cdedb77d472 req-48816dbe-d6c5-4eb5-b56f-66b16f477e3f tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] terminate connection for 94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:14:03 user cinder-volume[84560]: INFO cinder.volume.manager [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Deleting attachment 53719744-a818-4d6a-ad68-ce4423c988fb. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1167118353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94d1d134-5857-4a7c-bf52-bd818e828f3e,launched_at=2023-04-14T00:13:48Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP YrRJCHcL Iao2OgXFZDwCrm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:47Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:13:57Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] detach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e from target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-2f78254e-fef7-4687-9b55-9ab94fefcba6 tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] create export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] ensure volume 94d1d134-5857-4a7c-bf52-bd818e828f3e assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 94d1d134-5857-4a7c-bf52-bd818e828f3e to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] atach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e to target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:14:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3363343733396464', 'lun': 0, 'mode': 'wt', 'name': 'v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'prod_id': 'Storage', 'scsi_id': '3c4739dd0c0e6c33'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YrRJCHcL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 94d1d134-5857-4a7c-bf52-bd818e828f3e 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:14:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '43f78284-e8d9-43a3-94a8-79607874bb6b'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:14:09 user cinder-volume[84560]: INFO cinder.volume.manager [req-e9d5c34c-db8a-4e02-8046-1646a346bf25 req-79ebb4b6-44e4-4cf3-bdf9-2edbd8974415 tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Acquiring lock "cinder-8e63ed78-ec07-4e8f-8ec4-e81494a415a3-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Lock "cinder-8e63ed78-ec07-4e8f-8ec4-e81494a415a3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] remove_export for volume: 8e63ed78-ec07-4e8f-8ec4-e81494a415a3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-498124488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8e63ed78-ec07-4e8f-8ec4-e81494a415a3,launched_at=2023-04-14T00:06:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f138770c7b4407d83c449500fc000a5',provider_auth='CHAP GtexvRgE mPnoeECLQSkrYD',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:20Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:14:12Z,updated_at=2023-04-14T00:14:12Z,use_quota=True,user_id='6fe75acb64a94a2a88d370f43fa6b776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] detach volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 from target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3/luns/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] failed to remove resource iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 because of JDSS resource v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] delete target: iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] delete target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] failed to remove resource iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 because of JDSS resource iqn.2010-10.org.openstack:8e63ed78-ec07-4e8f-8ec4-e81494a415a3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] deleating volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] get snapshots for volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] get volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432190', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '163840', 'sharesmb': None, 'createtxg': '107811', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12317347801291585592', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '163840', 'logicalused': '1630208', 'compressratio': '15.30', 'rootcontext': 'none', 'default_scsi_id': '79a19d8ee4148d5f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341773312', 'san:volume_id': '79a19d8ee4148d5f9b8ec662b6591cb897679115', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '15.30', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '163840', 'objsetid': '78751', 'name': 'v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '163840', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] delete volume:v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] volume v_8e63ed78-ec07-4e8f-8ec4-e81494a415a3 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:14:13 user cinder-volume[84560]: DEBUG cinder.quota [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Created reservations ['68d1e558-4aab-489e-af25-98a097ca9542', 'a7b02c19-457b-428a-9c87-d8ece0fc7807', '41b031cf-8c7d-437c-8732-eb9b4dab608a', 'b60e53dd-d1df-4f2d-aaa8-1f6b4d7c2b7c'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:14:13 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Flow 'volume_create_manager' (19478d69-102d-4ccd-ace5-1e71b0340dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bff54ad-a077-40e8-a8ce-32e05f6c617f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bff54ad-a077-40e8-a8ce-32e05f6c617f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1133955403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9693166b-92aa-49ac-8a18-6a7a4ad4e119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20caf676a64b9b97027f3fc9bc724c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:14:14Z,use_quota=True,user_id='2f8b18d40ecd4b4e976cf2018af8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a917f8d-e053-4ec3-854e-c63cf2ff0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a917f8d-e053-4ec3-854e-c63cf2ff0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ae20d1-d356-49e4-9342-580605a33699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ae20d1-d356-49e4-9342-580605a33699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'volume_name': 'volume-9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df153979-68b5-4f64-a8d1-680306205afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df153979-68b5-4f64-a8d1-680306205afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404be92c-ef7a-4e64-a29d-6b6d38ce8d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Volume 9693166b-92aa-49ac-8a18-6a7a4ad4e119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'volume_size': 1} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] creating volume v_9693166b-92aa-49ac-8a18-6a7a4ad4e119. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] create volume {'name': 'v_9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341986304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.manager [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:14:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Deleted volume successfully. Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0cfe8693-e559-48b4-a837-29c608c06a16 tempest-TestStampPattern-1381824337 None] Lock "cinder-8e63ed78-ec07-4e8f-8ec4-e81494a415a3-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'is_clone': False, 'name': 'v_9693166b-92aa-49ac-8a18-6a7a4ad4e119'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (404be92c-ef7a-4e64-a29d-6b6d38ce8d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b5196b-4cbd-48f9-99ee-3ab02cc9045f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Volume volume-9693166b-92aa-49ac-8a18-6a7a4ad4e119 (9693166b-92aa-49ac-8a18-6a7a4ad4e119): created successfully Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62b5196b-4cbd-48f9-99ee-3ab02cc9045f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Flow 'volume_create_manager' (19478d69-102d-4ccd-ace5-1e71b0340dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:14:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-67c2272c-3348-4b4d-a2b0-f743837c7f4c tempest-AttachVolumeShelveTestJSON-1395403129 None] Created volume successfully. Apr 14 00:14:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114341904384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:14:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:14:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=51,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=47,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Acquiring lock "cinder-bb161de0-be74-4875-be21-dbca6bfcfc22-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:14:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Lock "cinder-bb161de0-be74-4875-be21-dbca6bfcfc22-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] remove_export for volume: bb161de0-be74-4875-be21-dbca6bfcfc22. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-665478096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb161de0-be74-4875-be21-dbca6bfcfc22,launched_at=2023-04-14T00:10:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dffbe999e60a4add9f23c83f9b0a4252',provider_auth='CHAP LEcXASpF w4RraemQNLqbMh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:10:42Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:14:32Z,updated_at=2023-04-14T00:14:32Z,use_quota=True,user_id='74d7e3d598e74c288e6a44996303b85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] detach volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 from target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22/luns/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] failed to remove resource iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 because of JDSS resource v_bb161de0-be74-4875-be21-dbca6bfcfc22 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] delete target: iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] delete target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] failed to remove resource iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 because of JDSS resource iqn.2010-10.org.openstack:bb161de0-be74-4875-be21-dbca6bfcfc22 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] deleating volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] get snapshots for volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] get volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bb161de0-be74-4875-be21-dbca6bfcfc22', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432452', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108099', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16300652710390102934', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9aefcb1c572827de', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341904384', 'san:volume_id': '9aefcb1c572827ded133d19e3c1c991d7eb7d67d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78154', 'name': 'v_bb161de0-be74-4875-be21-dbca6bfcfc22', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] delete volume:v_bb161de0-be74-4875-be21-dbca6bfcfc22 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb161de0-be74-4875-be21-dbca6bfcfc22 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] volume v_bb161de0-be74-4875-be21-dbca6bfcfc22 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.quota [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Created reservations ['7896a6f5-cdd3-4958-ab94-f1205a3072a7', '75d117ce-df5e-4d96-adca-7568dd69a83f', '5f482787-690f-4919-a3b5-9cecdd74df6b', '27213d6d-ea62-4f6b-9608-97061dd6a778'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341998592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:14:35 user cinder-volume[84560]: DEBUG cinder.manager [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:14:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Deleted volume successfully. Apr 14 00:14:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26987e7c-335a-4bcb-abfa-fbf789f986b0 tempest-VolumesAdminNegativeTest-1377720460 None] Lock "cinder-bb161de0-be74-4875-be21-dbca6bfcfc22-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Flow 'volume_create_manager' (412743b9-8081-4dfe-a893-e246f4fb6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb60b57f-19f2-40bb-bf53-85578c6886f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb60b57f-19f2-40bb-bf53-85578c6886f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1361506391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a000737d-73b0-475f-889c-00ea3ff4267e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524265958bd24a6cb94aa3115eb2b6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:14:40Z,use_quota=True,user_id='f43f3171ccad4167ac783bbdfe2df478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fffed7a-3dcd-4188-8fb1-e8abf5c120c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fffed7a-3dcd-4188-8fb1-e8abf5c120c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e046e1-4c37-49b6-868f-e0ce841eb30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e046e1-4c37-49b6-868f-e0ce841eb30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a000737d-73b0-475f-889c-00ea3ff4267e', 'volume_name': 'volume-a000737d-73b0-475f-889c-00ea3ff4267e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770b1f2-2d1e-496a-9b2e-9b76e8040e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8770b1f2-2d1e-496a-9b2e-9b76e8040e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425b8f44-3bf8-44f9-ac99-2c33f0ffd0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Volume a000737d-73b0-475f-889c-00ea3ff4267e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a000737d-73b0-475f-889c-00ea3ff4267e', 'volume_size': 1} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] creating volume v_a000737d-73b0-475f-889c-00ea3ff4267e. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] create volume {'name': 'v_a000737d-73b0-475f-889c-00ea3ff4267e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:14:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:14:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a000737d-73b0-475f-889c-00ea3ff4267e', 'is_clone': False, 'name': 'v_a000737d-73b0-475f-889c-00ea3ff4267e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:14:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (425b8f44-3bf8-44f9-ac99-2c33f0ffd0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a000737d-73b0-475f-889c-00ea3ff4267e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2291499-d509-4d10-8e64-a44dcdb068f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:14:41 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Volume volume-a000737d-73b0-475f-889c-00ea3ff4267e (a000737d-73b0-475f-889c-00ea3ff4267e): created successfully Apr 14 00:14:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2291499-d509-4d10-8e64-a44dcdb068f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:14:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Flow 'volume_create_manager' (412743b9-8081-4dfe-a893-e246f4fb6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:14:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-51668c72-43d4-46c6-903f-4b7b5e4cd3ec tempest-ServerRescueNegativeTestJSON-1055458768 None] Created volume successfully. Apr 14 00:14:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:14:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06978500-8f0a-4ccb-8a48-47fb0e55bddf tempest-VolumesActionsTest-422643142 None] Acquiring lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9" by "attach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06978500-8f0a-4ccb-8a48-47fb0e55bddf tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9" acquired by "attach_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:15:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-06978500-8f0a-4ccb-8a48-47fb0e55bddf tempest-VolumesActionsTest-422643142 None] Attaching volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 to instance 13860c45-6a4b-48ea-9d0f-d50656585637 at mountpoint /dev/vdb on host None. Apr 14 00:15:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-06978500-8f0a-4ccb-8a48-47fb0e55bddf tempest-VolumesActionsTest-422643142 None] Attach volume completed successfully. Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-06978500-8f0a-4ccb-8a48-47fb0e55bddf tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9" released by "attach_volume" :: held 0.057s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Acquiring lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-detach_volume" by "detach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-detach_volume" acquired by "detach_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:15:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Detaching volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 from instance 13860c45-6a4b-48ea-9d0f-d50656585637. Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] remove_export for volume: 6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711029289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cafbda8-d881-4ce4-b77f-a22e606d9ac9,launched_at=2023-04-14T00:13:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e9bf71f0644907979ec775c62a0b39',provider_auth='CHAP suTbmgUi f9v0LCHDY34Qes',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:15:10Z,use_quota=True,user_id='719f2342cc1d452daae3a4ded790f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] detach volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 from target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] failed to remove resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 because of JDSS resource v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] delete target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] delete target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] failed to remove resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 because of JDSS resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:15:10 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Detach volume completed successfully. Apr 14 00:15:10 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5350c133-3dab-4a54-a43c-9f0ecd726774 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-detach_volume" released by "detach_volume" :: held 0.106s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114341904384', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:15:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:15:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=19,cinder:UPDATE=4,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Flow 'volume_create_manager' (391f6c38-8a67-4317-9464-12667182248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9f04b4-8d4d-47ee-9c32-fc809a47d812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f9f04b4-8d4d-47ee-9c32-fc809a47d812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-967404472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d4a3ba2bf74b0ca07b1b23654e6980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:15:38Z,use_quota=True,user_id='93511d0d0b0e437cb9bd154567541205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71aa2d37-4d56-4f75-a698-9c87c2cb4e11),volume_type_id=71aa2d37-4d56-4f75-a698-9c87c2cb4e11)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cf1e7-015a-4499-9c55-75175d2a08b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8cf1e7-015a-4499-9c55-75175d2a08b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdca335-440e-44a5-a6e7-5cc8e5b1735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cdca335-440e-44a5-a6e7-5cc8e5b1735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'volume_name': 'volume-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2d5a10-0e46-45cd-b8b9-802ebb384bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2d5a10-0e46-45cd-b8b9-802ebb384bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d849e3c7-bb43-4034-8a36-117b9d784426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Volume cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'volume_size': 1} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] creating volume v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] create volume {'name': 'v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'is_clone': False, 'name': 'v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d849e3c7-bb43-4034-8a36-117b9d784426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3e759a-ed3f-4b6e-975f-983044036409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Volume volume-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd (cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd): created successfully Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb3e759a-ed3f-4b6e-975f-983044036409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Flow 'volume_create_manager' (391f6c38-8a67-4317-9464-12667182248e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-84769c28-41b5-442e-9bda-98d8174fb74d tempest-VolumeTypesTest-1713558765 None] Created volume successfully. Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341822464', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:15:39 user cinder-volume[84560]: DEBUG cinder.manager [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:15:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-546c6caa-dd4d-4fc5-afea-c1200f02d647 tempest-VolumeTypesTest-1713558765 None] Retype volume completed successfully. Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Acquiring lock "cinder-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Lock "cinder-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] remove_export for volume: cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-967404472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd,launched_at=2023-04-14T00:15:39Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='69d4a3ba2bf74b0ca07b1b23654e6980',provider_auth='CHAP zNBdSuca 5xuEFNdYOftHy3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:38Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:15:40Z,updated_at=2023-04-14T00:15:40Z,use_quota=True,user_id='93511d0d0b0e437cb9bd154567541205',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77c615d8-d5dd-4250-84a0-55d3c539c35c),volume_type_id=77c615d8-d5dd-4250-84a0-55d3c539c35c) from target:iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] detach volume v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd from target iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/luns/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/luns/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/luns/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/luns/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] failed to remove resource iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd because of JDSS resource v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] delete target: iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] delete target iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] failed to remove resource iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd because of JDSS resource iqn.2010-10.org.openstack:cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] deleating volume v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] get snapshots for volume v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] get volume v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432747', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108257', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7524263392477153687', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6c059021b4617495', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341822464', 'san:volume_id': '6c059021b46174952ce5dbad1b3cd5f68e0b7573', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79754', 'name': 'v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] delete volume:v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] volume v_cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:15:42 user cinder-volume[84560]: WARNING cinder.quota [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-1764168967 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-1764168967, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:15:42 user cinder-volume[84560]: WARNING cinder.quota [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-1764168967 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-1764168967, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.quota [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Created reservations ['8771e034-7738-434d-b9b7-985ac9932145', '478e0154-2424-4c8e-8a7e-7c622b16291e', 'b0af14d7-ea9c-47f7-9181-ae99e9042a93', 'd21e8c2d-0b13-49a0-b921-0170cccbef3f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341892096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.manager [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:15:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Deleted volume successfully. Apr 14 00:15:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-added51f-dacc-4273-9c76-7df369357171 tempest-VolumeTypesTest-1713558765 None] Lock "cinder-cd04339c-0cae-4e9f-8e37-c7c4c9c06bcd-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Flow 'volume_create_manager' (7799b696-4b43-4983-82f0-b31fb40b9b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6295f1-c66f-458e-b367-bbd69213cb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f6295f1-c66f-458e-b367-bbd69213cb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1532391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:15:49Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6245de-9d21-49fd-8ea7-82d96e4f819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef6245de-9d21-49fd-8ea7-82d96e4f819b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff87ebda-d4af-45e1-b3f9-fa454cb2be7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff87ebda-d4af-45e1-b3f9-fa454cb2be7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'volume_name': 'volume-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23f4aec-f90e-4ae1-a02f-7a4f484fbba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c23f4aec-f90e-4ae1-a02f-7a4f484fbba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f331aa-2588-45f1-b3e5-1afd5440d823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:49 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'volume_size': 1} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] creating volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] create volume {'name': 'v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'is_clone': False, 'name': 'v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f331aa-2588-45f1-b3e5-1afd5440d823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8270496e-4e67-4ab4-8acf-edfe9309f413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Volume volume-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 (ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1): created successfully Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8270496e-4e67-4ab4-8acf-edfe9309f413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Flow 'volume_create_manager' (7799b696-4b43-4983-82f0-b31fb40b9b7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4ef4e135-070e-442d-a7f9-5d02bead754d tempest-AttachVolumeNegativeTest-719597397 None] Created volume successfully. Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Flow 'volume_create_manager' (6b611e30-de06-4179-a015-99ec8354b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33026d21-d982-448a-9a9a-1ce3bfe19824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33026d21-d982-448a-9a9a-1ce3bfe19824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1441842179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64f2676d-d62c-4ea9-b13f-72b1677a5182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69be05040c2644bca499c0e9861bcfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:15:50Z,use_quota=True,user_id='546e48826b644f32823c66bacf8920df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1655a8c9-cbe0-4082-8179-92e1895fa716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1655a8c9-cbe0-4082-8179-92e1895fa716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4886b5-3053-4cb7-8ba6-8d3270189cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4886b5-3053-4cb7-8ba6-8d3270189cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64f2676d-d62c-4ea9-b13f-72b1677a5182', 'volume_name': 'volume-64f2676d-d62c-4ea9-b13f-72b1677a5182', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f92e3f-5587-4d32-8137-7ab4575cce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86f92e3f-5587-4d32-8137-7ab4575cce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26e7bf-35fa-44e6-b124-ece74b73504f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Volume 64f2676d-d62c-4ea9-b13f-72b1677a5182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64f2676d-d62c-4ea9-b13f-72b1677a5182', 'volume_size': 1} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] creating volume v_64f2676d-d62c-4ea9-b13f-72b1677a5182. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] create volume {'name': 'v_64f2676d-d62c-4ea9-b13f-72b1677a5182', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] create export for volume: ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] ensure volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] check if targe iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] create target and attach volume ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] create target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_64f2676d-d62c-4ea9-b13f-72b1677a5182', 'is_clone': False, 'name': 'v_64f2676d-d62c-4ea9-b13f-72b1677a5182'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c26e7bf-35fa-44e6-b124-ece74b73504f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64f2676d-d62c-4ea9-b13f-72b1677a5182', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d99158c-c6b5-4262-a216-8c1c98183af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Volume volume-64f2676d-d62c-4ea9-b13f-72b1677a5182 (64f2676d-d62c-4ea9-b13f-72b1677a5182): created successfully Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d99158c-c6b5-4262-a216-8c1c98183af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Flow 'volume_create_manager' (6b611e30-de06-4179-a015-99ec8354b469) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5a0c302a-9be8-44c4-bfcb-d2acc40f5604 tempest-VolumesTransfersTest-877639459 None] Created volume successfully. Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] terminate connection for 94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:15:51 user cinder-volume[84560]: INFO cinder.volume.manager [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Deleting attachment 43f78284-e8d9-43a3-94a8-79607874bb6b. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1167118353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94d1d134-5857-4a7c-bf52-bd818e828f3e,launched_at=2023-04-14T00:13:48Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP YrRJCHcL Iao2OgXFZDwCrm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:47Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:14:16Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] detach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e from target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-39b49c5b-1252-4438-a079-25c6f4b83a9a tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:15:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1c4ae161-e1a5-4708-8417-228baa335eb9 tempest-VolumesTransfersTest-1384846366 None] Transfer volume completed successfully. Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Acquiring lock "cinder-64f2676d-d62c-4ea9-b13f-72b1677a5182-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Lock "cinder-64f2676d-d62c-4ea9-b13f-72b1677a5182-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] remove_export for volume: 64f2676d-d62c-4ea9-b13f-72b1677a5182. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1441842179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=64f2676d-d62c-4ea9-b13f-72b1677a5182,launched_at=2023-04-14T00:15:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cf16bf635094c8597069467cdd518c8',provider_auth='CHAP ltRjsrHG UfuGRdxeimoJlW',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:50Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:15:53Z,updated_at=2023-04-14T00:15:53Z,use_quota=True,user_id='7237b8a166124d0b88c51355ee36437f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] detach volume v_64f2676d-d62c-4ea9-b13f-72b1677a5182 from target iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182/luns/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182/luns/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182/luns/v_64f2676d-d62c-4ea9-b13f-72b1677a5182'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182/luns/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] failed to remove resource iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 because of JDSS resource v_64f2676d-d62c-4ea9-b13f-72b1677a5182 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] delete target: iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] delete target iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] failed to remove resource iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 because of JDSS resource iqn.2010-10.org.openstack:64f2676d-d62c-4ea9-b13f-72b1677a5182 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] deleating volume v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] get snapshots for volume v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] atach volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 to target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] get volume v_64f2676d-d62c-4ea9-b13f-72b1677a5182 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_64f2676d-d62c-4ea9-b13f-72b1677a5182', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432760', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108267', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16748663836702746394', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fe05132951d3b958', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341728256', 'san:volume_id': 'fe05132951d3b958694e7600ba412c43ec89bd36', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '77674', 'name': 'v_64f2676d-d62c-4ea9-b13f-72b1677a5182', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] delete volume:v_64f2676d-d62c-4ea9-b13f-72b1677a5182 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] create export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] ensure volume 94d1d134-5857-4a7c-bf52-bd818e828f3e assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3335666464393062', 'lun': 0, 'mode': 'wt', 'name': 'v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'prod_id': 'Storage', 'scsi_id': '35fdd90b9c57647b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] add credentails to target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'name': 'sfVBgCIN'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] initialize_connection for ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sfVBgCIN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '7ff32392-3588-4516-b84a-d3043efb571f'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:15:55 user cinder-volume[84560]: INFO cinder.volume.manager [req-5323c647-7aeb-49f2-8848-03656abe585a req-3e2c0327-b1bf-45c9-9c64-86a53cf783c2 tempest-AttachVolumeNegativeTest-719597397 None] attachment_update completed successfully. Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_64f2676d-d62c-4ea9-b13f-72b1677a5182 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] volume v_64f2676d-d62c-4ea9-b13f-72b1677a5182 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=60,cinder:UPDATE=18,cinder:INSERT=2,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 94d1d134-5857-4a7c-bf52-bd818e828f3e to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=67,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.quota [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Created reservations ['804f785b-5796-4363-902d-2cda2a259cb1', 'c1620ec0-3e65-4fb3-a11f-6ba04571e5d8', '411089ec-9d28-4da3-9fbd-f626a1a14b88', '851ca443-bfaa-4423-97ea-665c5c7e692b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Flow 'volume_create_manager' (9c486d03-db99-48ee-866f-c777a570c11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97d692a-7fb0-4482-b347-4d74825c7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97d692a-7fb0-4482-b347-4d74825c7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-421851941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb27a156-9199-4b11-a202-030e0f3cce18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69be05040c2644bca499c0e9861bcfdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:15:57Z,use_quota=True,user_id='546e48826b644f32823c66bacf8920df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a57bdff-6dcb-43f6-b365-2d8b2cca4b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a57bdff-6dcb-43f6-b365-2d8b2cca4b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f278772b-3fb5-40f6-8876-0c7e040d56b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f278772b-3fb5-40f6-8876-0c7e040d56b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb27a156-9199-4b11-a202-030e0f3cce18', 'volume_name': 'volume-bb27a156-9199-4b11-a202-030e0f3cce18', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe513a1-20cc-4a4a-ad04-50e0a7e68e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbe513a1-20cc-4a4a-ad04-50e0a7e68e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42107ab-3cc1-44ce-9dd1-c8d7d1d75b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:57 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Volume bb27a156-9199-4b11-a202-030e0f3cce18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb27a156-9199-4b11-a202-030e0f3cce18', 'volume_size': 1} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] creating volume v_bb27a156-9199-4b11-a202-030e0f3cce18. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] create volume {'name': 'v_bb27a156-9199-4b11-a202-030e0f3cce18', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bb27a156-9199-4b11-a202-030e0f3cce18', 'is_clone': False, 'name': 'v_bb27a156-9199-4b11-a202-030e0f3cce18'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42107ab-3cc1-44ce-9dd1-c8d7d1d75b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb27a156-9199-4b11-a202-030e0f3cce18', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc666bc-6876-490c-a4f9-fb6bc54b34aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:15:58 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Volume volume-bb27a156-9199-4b11-a202-030e0f3cce18 (bb27a156-9199-4b11-a202-030e0f3cce18): created successfully Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc666bc-6876-490c-a4f9-fb6bc54b34aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Flow 'volume_create_manager' (9c486d03-db99-48ee-866f-c777a570c11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:15:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2df9ef32-bf03-4e51-975f-29494fdefa06 tempest-VolumesTransfersTest-877639459 None] Created volume successfully. Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] atach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e to target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341728256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.manager [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:15:59 user cinder-volume[84560]: INFO cinder.volume.manager [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Deleted volume successfully. Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-24e68524-0530-4cc6-b36f-cbc812cb9b3f tempest-VolumesTransfersTest-729279900 None] Lock "cinder-64f2676d-d62c-4ea9-b13f-72b1677a5182-delete_volume" released by "delete_volume" :: held 5.743s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] terminate connection for ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:15:59 user cinder-volume[84560]: INFO cinder.volume.manager [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Terminate volume connection completed successfully. Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Deleting attachment 7ff32392-3588-4516-b84a-d3043efb571f. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] remove_export for volume: ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1532391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1,launched_at=2023-04-14T00:15:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth='CHAP sfVBgCIN LNsI2zJyqH0gTx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:15:59Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] detach volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 from target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Acquiring lock "cinder-bb27a156-9199-4b11-a202-030e0f3cce18-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Lock "cinder-bb27a156-9199-4b11-a202-030e0f3cce18-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] remove_export for volume: bb27a156-9199-4b11-a202-030e0f3cce18. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-421851941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bb27a156-9199-4b11-a202-030e0f3cce18,launched_at=2023-04-14T00:15:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69be05040c2644bca499c0e9861bcfdc',provider_auth='CHAP CPqWISlv Xg3rPs7dEecnUI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:57Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:00Z,updated_at=2023-04-14T00:16:00Z,use_quota=True,user_id='546e48826b644f32823c66bacf8920df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] detach volume v_bb27a156-9199-4b11-a202-030e0f3cce18 from target iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18/luns/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18/luns/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18/luns/v_bb27a156-9199-4b11-a202-030e0f3cce18'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18/luns/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] failed to remove resource iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 because of JDSS resource v_bb27a156-9199-4b11-a202-030e0f3cce18 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] delete target: iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] delete target iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] failed to remove resource iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 because of JDSS resource iqn.2010-10.org.openstack:bb27a156-9199-4b11-a202-030e0f3cce18 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] deleating volume v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] get snapshots for volume v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:15:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] get volume v_bb27a156-9199-4b11-a202-030e0f3cce18 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bb27a156-9199-4b11-a202-030e0f3cce18', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432767', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108276', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6113051511970939977', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9f9cb7ec2f1dc62f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341728256', 'san:volume_id': '9f9cb7ec2f1dc62f5ed93e6742cda908a3b80857', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79498', 'name': 'v_bb27a156-9199-4b11-a202-030e0f3cce18', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] delete volume:v_bb27a156-9199-4b11-a202-030e0f3cce18 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3363343733396464', 'lun': 0, 'mode': 'wt', 'name': 'v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'prod_id': 'Storage', 'scsi_id': '3c4739dd0c0e6c33'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] delete target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] delete target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'YrRJCHcL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 94d1d134-5857-4a7c-bf52-bd818e828f3e 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YrRJCHcL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '54e4b1f5-010b-4766-ab8a-d6eea6f1f43b'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:16:01 user cinder-volume[84560]: INFO cinder.volume.manager [req-ec3d3d8a-187a-46a7-959e-d4f07b97d919 req-2a04bbcb-87b0-4e9f-a117-033d29e416f0 tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-24459fcb-cd10-4d30-b933-6998cd4ebd31 req-be56070f-b1ef-46ef-9e68-8ceed44c4ffa tempest-AttachVolumeNegativeTest-719597397 None] target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bb27a156-9199-4b11-a202-030e0f3cce18 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] volume v_bb27a156-9199-4b11-a202-030e0f3cce18 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.quota [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Created reservations ['e90e7089-2a0f-48a6-a270-64c13d7ad19f', 'eedd8909-4b3c-4c28-99ba-9f4bdbb9be34', '3fe35053-b16a-4096-8f04-7270271f53af', '3a824222-3c62-4058-8b9b-bf34815ff3da'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341810176', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:02 user cinder-volume[84560]: DEBUG cinder.manager [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Deleted volume successfully. Apr 14 00:16:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a912db75-8be4-47c2-8104-02a38298c024 tempest-VolumesTransfersTest-729279900 None] Lock "cinder-bb27a156-9199-4b11-a202-030e0f3cce18-delete_volume" released by "delete_volume" :: held 2.956s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (32abf5bf-3924-4acd-ad2e-67e5b3058eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dae6f13-7bdd-4322-80fd-6f8f48350093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dae6f13-7bdd-4322-80fd-6f8f48350093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1720207022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=86c38166-1dd9-4804-93b5-ccd059939c6e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:07Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7add035-672f-467c-a202-a69ca76f2799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7add035-672f-467c-a202-a69ca76f2799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75aae049-dd85-4d17-87cb-53de62c415e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75aae049-dd85-4d17-87cb-53de62c415e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86c38166-1dd9-4804-93b5-ccd059939c6e', 'volume_name': 'volume-86c38166-1dd9-4804-93b5-ccd059939c6e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97f2841-46e3-4fa2-9cd1-1567d0ff9a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c97f2841-46e3-4fa2-9cd1-1567d0ff9a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630b21ac-03ee-4ad7-8e3b-99a4a06e1d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:06 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Volume 86c38166-1dd9-4804-93b5-ccd059939c6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86c38166-1dd9-4804-93b5-ccd059939c6e', 'volume_size': 1} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] creating volume v_86c38166-1dd9-4804-93b5-ccd059939c6e. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] create volume {'name': 'v_86c38166-1dd9-4804-93b5-ccd059939c6e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_86c38166-1dd9-4804-93b5-ccd059939c6e', 'is_clone': False, 'name': 'v_86c38166-1dd9-4804-93b5-ccd059939c6e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630b21ac-03ee-4ad7-8e3b-99a4a06e1d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86c38166-1dd9-4804-93b5-ccd059939c6e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c9f6d8-12a9-49c1-8695-c3995cc4b2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:07 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Volume volume-86c38166-1dd9-4804-93b5-ccd059939c6e (86c38166-1dd9-4804-93b5-ccd059939c6e): created successfully Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c9f6d8-12a9-49c1-8695-c3995cc4b2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (32abf5bf-3924-4acd-ad2e-67e5b3058eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-18980d93-ee05-4a54-9dfb-73891db33656 tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-91a55e35-4696-475d-8b97-cadbbd45d2d4 req-2ade6558-b3be-4219-a7a0-2eb367394a15 tempest-AttachVolumeShelveTestJSON-1395403129 None] No connector for attachment 86a62033-0b50-45e0-8725-c8c24273f1fc; skipping storage backend terminate_connection call. {{(pid=84560) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4961}} Apr 14 00:16:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-91a55e35-4696-475d-8b97-cadbbd45d2d4 req-2ade6558-b3be-4219-a7a0-2eb367394a15 tempest-AttachVolumeShelveTestJSON-1395403129 None] Deleting attachment 86a62033-0b50-45e0-8725-c8c24273f1fc. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (9e42a35b-7bd7-4ce6-adf3-a566959486b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b85df09-3bec-40eb-9e9e-1967291a0099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b85df09-3bec-40eb-9e9e-1967291a0099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1252252803',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9d6e709c-87f7-45f3-a348-422e8d9b6002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:10Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19031de8-4fa4-4676-a0ea-a6fec41efd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19031de8-4fa4-4676-a0ea-a6fec41efd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e860ca3-ab67-4a25-9842-28889ad4acf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e860ca3-ab67-4a25-9842-28889ad4acf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d6e709c-87f7-45f3-a348-422e8d9b6002', 'volume_name': 'volume-9d6e709c-87f7-45f3-a348-422e8d9b6002', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a25a1ea-9a83-46f8-9aee-f371dba6880a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a25a1ea-9a83-46f8-9aee-f371dba6880a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242e982-65a7-4158-89b2-9248c9dcfe64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:09 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Volume 9d6e709c-87f7-45f3-a348-422e8d9b6002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d6e709c-87f7-45f3-a348-422e8d9b6002', 'volume_size': 1} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] creating volume v_9d6e709c-87f7-45f3-a348-422e8d9b6002. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] create volume {'name': 'v_9d6e709c-87f7-45f3-a348-422e8d9b6002', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9d6e709c-87f7-45f3-a348-422e8d9b6002', 'is_clone': False, 'name': 'v_9d6e709c-87f7-45f3-a348-422e8d9b6002'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:10 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4242e982-65a7-4158-89b2-9248c9dcfe64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d6e709c-87f7-45f3-a348-422e8d9b6002', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:10 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f16ebfe-b0c4-4973-943d-20f6879386ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:10 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Volume volume-9d6e709c-87f7-45f3-a348-422e8d9b6002 (9d6e709c-87f7-45f3-a348-422e8d9b6002): created successfully Apr 14 00:16:10 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f16ebfe-b0c4-4973-943d-20f6879386ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:10 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (9e42a35b-7bd7-4ce6-adf3-a566959486b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:10 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5cf73546-4c38-4bd4-8ff2-651fb306b159 tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-9d6e709c-87f7-45f3-a348-422e8d9b6002-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Lock "cinder-9d6e709c-87f7-45f3-a348-422e8d9b6002-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] remove_export for volume: 9d6e709c-87f7-45f3-a348-422e8d9b6002. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1720207022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9d6e709c-87f7-45f3-a348-422e8d9b6002,launched_at=2023-04-14T00:16:11Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP PvFiOZjt TN7chau50ZW1OQ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:10Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:12Z,updated_at=2023-04-14T00:16:12Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] detach volume v_9d6e709c-87f7-45f3-a348-422e8d9b6002 from target iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002/luns/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002/luns/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002/luns/v_9d6e709c-87f7-45f3-a348-422e8d9b6002'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002/luns/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 because of JDSS resource v_9d6e709c-87f7-45f3-a348-422e8d9b6002 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 because of JDSS resource iqn.2010-10.org.openstack:9d6e709c-87f7-45f3-a348-422e8d9b6002 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] deleating volume v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] get volume v_9d6e709c-87f7-45f3-a348-422e8d9b6002 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9d6e709c-87f7-45f3-a348-422e8d9b6002', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432779', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108290', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16566031797335934095', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '200a93c8d6f9299d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341621760', 'san:volume_id': '200a93c8d6f9299dc4ce51ea4dde58a8518dc48b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79518', 'name': 'v_9d6e709c-87f7-45f3-a348-422e8d9b6002', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] delete volume:v_9d6e709c-87f7-45f3-a348-422e8d9b6002 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9d6e709c-87f7-45f3-a348-422e8d9b6002 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] volume v_9d6e709c-87f7-45f3-a348-422e8d9b6002 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.quota [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Created reservations ['bff4c9df-c0ce-4fef-a366-664eb60269ff', 'c6728d7c-fe0e-4700-aa75-cc0e72aee9ef', '2d50ef68-644f-4ccc-beb7-68bcda6dad1c', 'ff405ae4-9c99-4406-ad41-58a8113c273f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341703680', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.manager [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:15 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4042d94f-028d-4d76-b6a7-538a0a0d383d tempest-VolumesGetTest-1053284712 None] Lock "cinder-9d6e709c-87f7-45f3-a348-422e8d9b6002-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-86c38166-1dd9-4804-93b5-ccd059939c6e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Lock "cinder-86c38166-1dd9-4804-93b5-ccd059939c6e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=61,cinder:INSERT=5,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] remove_export for volume: 86c38166-1dd9-4804-93b5-ccd059939c6e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:07Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-2112670271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=86c38166-1dd9-4804-93b5-ccd059939c6e,launched_at=2023-04-14T00:16:08Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP qBwvuEUO 82FzsV45vLgkI7',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:07Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:15Z,updated_at=2023-04-14T00:16:15Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] detach volume v_86c38166-1dd9-4804-93b5-ccd059939c6e from target iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e/luns/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e/luns/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e/luns/v_86c38166-1dd9-4804-93b5-ccd059939c6e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e/luns/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e because of JDSS resource v_86c38166-1dd9-4804-93b5-ccd059939c6e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e because of JDSS resource iqn.2010-10.org.openstack:86c38166-1dd9-4804-93b5-ccd059939c6e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] deleating volume v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] get volume v_86c38166-1dd9-4804-93b5-ccd059939c6e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_86c38166-1dd9-4804-93b5-ccd059939c6e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432776', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108286', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14895459899350749932', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3463d9d77b89be15', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341703680', 'san:volume_id': '3463d9d77b89be1567be8ac8a7069860c9335ca4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79509', 'name': 'v_86c38166-1dd9-4804-93b5-ccd059939c6e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] delete volume:v_86c38166-1dd9-4804-93b5-ccd059939c6e recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_86c38166-1dd9-4804-93b5-ccd059939c6e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] volume v_86c38166-1dd9-4804-93b5-ccd059939c6e deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:17 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=32,cinder:SELECT=58,cinder:DELETE=5,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.quota [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Created reservations ['2191da88-65fa-472a-b8e8-91df6ef33f47', '8bb5b090-665a-4c80-bcc5-1389fa6e52d6', '3faf076e-787d-4a49-89ff-a90ade4b91fa', 'ac1037dc-596b-4482-a53e-91edfb54b159'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341797888', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.manager [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:18 user cinder-volume[84560]: INFO cinder.volume.manager [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (999dedeb-bca9-462a-9aeb-aaee35d24693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120e7d22-79d5-4165-aebc-5ca21fa72251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.coordination [None req-837d325e-97c7-4676-af00-c7e138258a20 tempest-VolumesGetTest-1053284712 None] Lock "cinder-86c38166-1dd9-4804-93b5-ccd059939c6e-delete_volume" released by "delete_volume" :: held 3.687s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (120e7d22-79d5-4165-aebc-5ca21fa72251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-226129002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0d721c30-97da-4ddc-8f41-58025fe23351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:19Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c966e83-8a51-47f4-beb0-66084275a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c966e83-8a51-47f4-beb0-66084275a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e001123e-0f36-4a5a-aa8c-c32875bc330e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e001123e-0f36-4a5a-aa8c-c32875bc330e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d721c30-97da-4ddc-8f41-58025fe23351', 'volume_name': 'volume-0d721c30-97da-4ddc-8f41-58025fe23351', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f03345-ffec-4906-aad7-f03adfed5883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f03345-ffec-4906-aad7-f03adfed5883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4493e023-6a6c-46f5-b78b-3b705ef989f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:18 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Volume 0d721c30-97da-4ddc-8f41-58025fe23351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d721c30-97da-4ddc-8f41-58025fe23351', 'volume_size': 1} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] creating volume v_0d721c30-97da-4ddc-8f41-58025fe23351. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] create volume {'name': 'v_0d721c30-97da-4ddc-8f41-58025fe23351', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0d721c30-97da-4ddc-8f41-58025fe23351', 'is_clone': False, 'name': 'v_0d721c30-97da-4ddc-8f41-58025fe23351'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4493e023-6a6c-46f5-b78b-3b705ef989f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d721c30-97da-4ddc-8f41-58025fe23351', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8803c35a-b420-4ec1-b603-ffed9a245ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:19 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Volume volume-0d721c30-97da-4ddc-8f41-58025fe23351 (0d721c30-97da-4ddc-8f41-58025fe23351): created successfully Apr 14 00:16:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8803c35a-b420-4ec1-b603-ffed9a245ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (999dedeb-bca9-462a-9aeb-aaee35d24693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3e573e74-5c53-4385-8951-fcef485bc713 tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (5edbb761-b327-462e-b4c7-802d862cc232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05b553b-fa61-41e7-b6a7-e8cdbe6f7200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c05b553b-fa61-41e7-b6a7-e8cdbe6f7200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-757604635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f73ef561-f163-4db0-b01d-435643654581,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0d721c30-97da-4ddc-8f41-58025fe23351,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:21Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1ca3f8-bf6e-4ac4-8987-aea4f7d20c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce1ca3f8-bf6e-4ac4-8987-aea4f7d20c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f078bc-b9f3-445b-aaab-28a2305e8fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2f078bc-b9f3-445b-aaab-28a2305e8fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f73ef561-f163-4db0-b01d-435643654581', 'volume_name': 'volume-f73ef561-f163-4db0-b01d-435643654581', 'volume_size': 1, 'source_volid': '0d721c30-97da-4ddc-8f41-58025fe23351', 'source_volstatus': 'available'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a80cf6-975d-4d23-ad14-7ac05ba190c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a80cf6-975d-4d23-ad14-7ac05ba190c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c33430-90fb-4395-9928-4f4ff88a2d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:21 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Volume f73ef561-f163-4db0-b01d-435643654581: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f73ef561-f163-4db0-b01d-435643654581', 'volume_size': 1, 'source_volid': '0d721c30-97da-4ddc-8f41-58025fe23351', 'source_volstatus': 'available'} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] cloned volume 0d721c30-97da-4ddc-8f41-58025fe23351 to f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] cloning v_0d721c30-97da-4ddc-8f41-58025fe23351 to v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] create snapshot v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114341715968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f73ef561-f163-4db0-b01d-435643654581'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] create volume v_f73ef561-f163-4db0-b01d-435643654581 from snapshot v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0d721c30-97da-4ddc-8f41-58025fe23351@v_f73ef561-f163-4db0-b01d-435643654581', 'is_clone': True, 'full_name': 'Pool-0/v_f73ef561-f163-4db0-b01d-435643654581', 'name': 'v_f73ef561-f163-4db0-b01d-435643654581'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] get volume v_f73ef561-f163-4db0-b01d-435643654581 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0d721c30-97da-4ddc-8f41-58025fe23351@v_f73ef561-f163-4db0-b01d-435643654581', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f73ef561-f163-4db0-b01d-435643654581', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432792', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108302', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1660116508280099073', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4f15d0a0b4d40325', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341691392', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79683', 'name': 'v_f73ef561-f163-4db0-b01d-435643654581', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93c33430-90fb-4395-9928-4f4ff88a2d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73ef561-f163-4db0-b01d-435643654581', 'volume_size': 1, 'source_volid': '0d721c30-97da-4ddc-8f41-58025fe23351', 'source_volstatus': 'available'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6250b89d-0162-416e-8e96-cc75d0b1c045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:23 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Volume volume-f73ef561-f163-4db0-b01d-435643654581 (f73ef561-f163-4db0-b01d-435643654581): created successfully Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6250b89d-0162-416e-8e96-cc75d0b1c045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (5edbb761-b327-462e-b4c7-802d862cc232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:23 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f44a1c34-0867-4a9f-babf-02addaa5ea81 tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (e3c4df29-f3a2-4163-834b-d2cb411043ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f1f715-e094-4f95-98a6-c4d412d38fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f1f715-e094-4f95-98a6-c4d412d38fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1271525573',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c1bec8b1-f3dd-4690-bbe5-3db759bca897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:24Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43c550d-921d-4aa6-9728-57f470bd7799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43c550d-921d-4aa6-9728-57f470bd7799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd78bb4-14a7-4ffb-9cfd-1c9296325f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbd78bb4-14a7-4ffb-9cfd-1c9296325f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'volume_name': 'volume-c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29032841-5071-49de-be9d-7f8594d162f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29032841-5071-49de-be9d-7f8594d162f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a2218-bd7d-4f82-9b26-a810ab285b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Volume c1bec8b1-f3dd-4690-bbe5-3db759bca897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'volume_size': 1} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] creating volume v_c1bec8b1-f3dd-4690-bbe5-3db759bca897. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] create volume {'name': 'v_c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'is_clone': False, 'name': 'v_c1bec8b1-f3dd-4690-bbe5-3db759bca897'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160a2218-bd7d-4f82-9b26-a810ab285b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59bbc74-44c7-4bb1-9908-56ff864602e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Volume volume-c1bec8b1-f3dd-4690-bbe5-3db759bca897 (c1bec8b1-f3dd-4690-bbe5-3db759bca897): created successfully Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d59bbc74-44c7-4bb1-9908-56ff864602e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (e3c4df29-f3a2-4163-834b-d2cb411043ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:24 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d165b9e4-2427-4638-9100-3bb3cbe51e3d tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Acquiring lock "cinder-fab467fd-34da-43fc-9994-5bc67d32a8f8-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Lock "cinder-fab467fd-34da-43fc-9994-5bc67d32a8f8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] remove_export for volume: fab467fd-34da-43fc-9994-5bc67d32a8f8. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1206800891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fab467fd-34da-43fc-9994-5bc67d32a8f8,launched_at=2023-04-14T00:13:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d9d27c26e8e4b529040d8909aec1a04',provider_auth='CHAP PEZwWShA tRYzca7SClTw96',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:36Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:25Z,updated_at=2023-04-14T00:16:25Z,use_quota=True,user_id='bb07ce4305014dfaacd6283e4fcab068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] detach volume v_fab467fd-34da-43fc-9994-5bc67d32a8f8 from target iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8/luns/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8/luns/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8/luns/v_fab467fd-34da-43fc-9994-5bc67d32a8f8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8/luns/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] failed to remove resource iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 because of JDSS resource v_fab467fd-34da-43fc-9994-5bc67d32a8f8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] delete target: iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] delete target iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] failed to remove resource iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 because of JDSS resource iqn.2010-10.org.openstack:fab467fd-34da-43fc-9994-5bc67d32a8f8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] deleating volume v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] get snapshots for volume v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-c1bec8b1-f3dd-4690-bbe5-3db759bca897-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Lock "cinder-c1bec8b1-f3dd-4690-bbe5-3db759bca897-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] remove_export for volume: c1bec8b1-f3dd-4690-bbe5-3db759bca897. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-757604635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c1bec8b1-f3dd-4690-bbe5-3db759bca897,launched_at=2023-04-14T00:16:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP GSKnLQEH uAJKkbizY40jFx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:25Z,updated_at=2023-04-14T00:16:25Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] detach volume v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 from target iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897/luns/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897/luns/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897/luns/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897/luns/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 because of JDSS resource v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 because of JDSS resource iqn.2010-10.org.openstack:c1bec8b1-f3dd-4690-bbe5-3db759bca897 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] deleating volume v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] get volume v_fab467fd-34da-43fc-9994-5bc67d32a8f8 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fab467fd-34da-43fc-9994-5bc67d32a8f8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432626', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108209', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11898049797154060916', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b83d2e45f755d223', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341584896', 'san:volume_id': 'b83d2e45f755d2231cbaa5b8dd83bd43b492e29a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79660', 'name': 'v_fab467fd-34da-43fc-9994-5bc67d32a8f8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] delete volume:v_fab467fd-34da-43fc-9994-5bc67d32a8f8 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] get volume v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432794', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108306', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12069891621707942709', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3ea0ad5afaee3789', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341584896', 'san:volume_id': '3ea0ad5afaee378908eebd174c73253a0c98b884', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79695', 'name': 'v_c1bec8b1-f3dd-4690-bbe5-3db759bca897', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] delete volume:v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fab467fd-34da-43fc-9994-5bc67d32a8f8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] volume v_fab467fd-34da-43fc-9994-5bc67d32a8f8 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.quota [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Created reservations ['ddcab1c6-e736-4d3c-a866-43d294da99f9', '3050162b-4b5e-4c71-aab6-28c725256672', '37b1a69f-efb1-405a-a5c9-b2d182b1c75b', 'b6e8c516-71dd-4ac3-b625-89f137ad794d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] volume v_c1bec8b1-f3dd-4690-bbe5-3db759bca897 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.quota [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Created reservations ['c36799ad-0a20-4966-9475-0c18ec7b37c3', '79e7e018-05c5-4fac-b9ff-90c6a91567f4', '7bc54126-8c9c-4b9f-8361-0c037810559e', 'e7f64102-4c25-469d-89c2-073907c5e1f1'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341715968', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.manager [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-48229489-e388-476c-af70-71d3f88f4890 tempest-VolumesGetTest-1053284712 None] Lock "cinder-c1bec8b1-f3dd-4690-bbe5-3db759bca897-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341748736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.manager [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Deleted volume successfully. Apr 14 00:16:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-61108e8a-dd1a-48d9-8792-f5bffbc3a706 tempest-VolumesNegativeTest-1085100121 None] Lock "cinder-fab467fd-34da-43fc-9994-5bc67d32a8f8-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-f73ef561-f163-4db0-b01d-435643654581-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Lock "cinder-f73ef561-f163-4db0-b01d-435643654581-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] remove_export for volume: f73ef561-f163-4db0-b01d-435643654581. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:21Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-420204983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f73ef561-f163-4db0-b01d-435643654581,launched_at=2023-04-14T00:16:23Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP McNZboln T6doNzqI4KMmve',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:21Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0d721c30-97da-4ddc-8f41-58025fe23351,status='deleting',terminated_at=2023-04-14T00:16:28Z,updated_at=2023-04-14T00:16:28Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] detach volume v_f73ef561-f163-4db0-b01d-435643654581 from target iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581/luns/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581/luns/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581/luns/v_f73ef561-f163-4db0-b01d-435643654581'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581/luns/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 because of JDSS resource v_f73ef561-f163-4db0-b01d-435643654581 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 because of JDSS resource iqn.2010-10.org.openstack:f73ef561-f163-4db0-b01d-435643654581 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] deleating volume v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] get volume v_f73ef561-f163-4db0-b01d-435643654581 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0d721c30-97da-4ddc-8f41-58025fe23351@v_f73ef561-f163-4db0-b01d-435643654581', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f73ef561-f163-4db0-b01d-435643654581', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432792', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108302', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1660116508280099073', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4f15d0a0b4d40325', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341748736', 'san:volume_id': '4f15d0a0b4d4032547b7eb602f78e05a3ac7e33f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79683', 'name': 'v_f73ef561-f163-4db0-b01d-435643654581', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] delete snapshot v_f73ef561-f163-4db0-b01d-435643654581 of volume v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots/v_f73ef561-f163-4db0-b01d-435643654581 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] snapshot v_f73ef561-f163-4db0-b01d-435643654581 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=62,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:INSERT=8,cinder:UPDATE=34,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Created reservations ['c600be4d-133b-4a73-a4f9-81a4bb82d517', '09b5f18d-b84b-4cb3-bffe-5eece1764746', 'b1bcaefc-b044-4d4e-b731-34c035f23496', 'c21ac056-a205-4002-9e61-14b8ae418a13'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341773312', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.manager [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a50f1974-3d27-47e6-b68a-ccef56d39499 tempest-VolumesGetTest-1053284712 None] Lock "cinder-f73ef561-f163-4db0-b01d-435643654581-delete_volume" released by "delete_volume" :: held 3.195s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-0d721c30-97da-4ddc-8f41-58025fe23351-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Lock "cinder-0d721c30-97da-4ddc-8f41-58025fe23351-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] remove_export for volume: 0d721c30-97da-4ddc-8f41-58025fe23351. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-226129002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0d721c30-97da-4ddc-8f41-58025fe23351,launched_at=2023-04-14T00:16:20Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP GUZoLmeg 7fYPQHdZzjcLDq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:19Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:32Z,updated_at=2023-04-14T00:16:32Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] detach volume v_0d721c30-97da-4ddc-8f41-58025fe23351 from target iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351/luns/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351/luns/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351/luns/v_0d721c30-97da-4ddc-8f41-58025fe23351'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351/luns/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 because of JDSS resource v_0d721c30-97da-4ddc-8f41-58025fe23351 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 because of JDSS resource iqn.2010-10.org.openstack:0d721c30-97da-4ddc-8f41-58025fe23351 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] deleating volume v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] get volume v_0d721c30-97da-4ddc-8f41-58025fe23351 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0d721c30-97da-4ddc-8f41-58025fe23351', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432789', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108296', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2950924320038378598', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5aac4c477433d696', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341773312', 'san:volume_id': '5aac4c477433d6967a616a3ef536f4a03d113260', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79670', 'name': 'v_0d721c30-97da-4ddc-8f41-58025fe23351', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] delete volume:v_0d721c30-97da-4ddc-8f41-58025fe23351 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0d721c30-97da-4ddc-8f41-58025fe23351 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] volume v_0d721c30-97da-4ddc-8f41-58025fe23351 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.quota [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Created reservations ['9ce442c2-90df-41f2-8305-b75c42e15e60', '526f0f3f-d165-49e3-86a5-889464ea37f0', '17708ea0-f5e2-4ede-b267-a90735e3a3d4', 'f4db0143-bbb3-4cdf-a025-16208b30b8da'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341855232', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.manager [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b84a36b8-2870-4be0-9ebd-b7797cd6119e tempest-VolumesGetTest-1053284712 None] Lock "cinder-0d721c30-97da-4ddc-8f41-58025fe23351-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (24836c7f-817f-458d-89a4-0707636a6105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee81c84-272b-486d-bf0c-d9c300d8d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee81c84-272b-486d-bf0c-d9c300d8d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-286619410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c29a3a7e-6e56-4393-97e5-0cf0cf92c3db,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:36Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84236a3f-8952-4221-a15b-fac4e5c5eea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84236a3f-8952-4221-a15b-fac4e5c5eea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aa43b9-8c64-4901-8e4f-62b0bacf05d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1aa43b9-8c64-4901-8e4f-62b0bacf05d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'volume_name': 'volume-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d213a0c7-ef85-4a65-8df3-a117a41460b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d213a0c7-ef85-4a65-8df3-a117a41460b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9142d4a-99fa-4f0b-bc52-8430f29c783d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:36 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Volume c29a3a7e-6e56-4393-97e5-0cf0cf92c3db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Cloning c29a3a7e-6e56-4393-97e5-0cf0cf92c3db from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 16, 36, 47207)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 16, 36, 60910)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] create snapshot v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] create volume v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db from snapshot v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'is_clone': True, 'full_name': 'Pool-0/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'name': 'v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] get volume v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432806', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108318', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4532034081727457130', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fec22048ee65b28d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341818368', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79709', 'name': 'v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Marking volume c29a3a7e-6e56-4393-97e5-0cf0cf92c3db as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to c29a3a7e-6e56-4393-97e5-0cf0cf92c3db. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:16:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Creating volume glance metadata for volume c29a3a7e-6e56-4393-97e5-0cf0cf92c3db backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:16:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9142d4a-99fa-4f0b-bc52-8430f29c783d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986c7488-b6be-4874-9900-82e86a027c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Volume volume-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db (c29a3a7e-6e56-4393-97e5-0cf0cf92c3db): created successfully Apr 14 00:16:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986c7488-b6be-4874-9900-82e86a027c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (24836c7f-817f-458d-89a4-0707636a6105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-bae84558-5bfe-40be-831a-d9b8e2978521 tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (e4ef2b80-a9b7-4991-9ce2-26343de2b0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9593abac-99b5-4c66-8d82-4be3c1870c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9593abac-99b5-4c66-8d82-4be3c1870c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-811975373',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=97bb0375-1ebe-4ef0-870c-206481f264dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:40Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd17b96d-f1ac-43a4-9a96-e8e1d436440c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd17b96d-f1ac-43a4-9a96-e8e1d436440c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bad906-4752-4f14-b50d-2087badc3e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bad906-4752-4f14-b50d-2087badc3e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bb0375-1ebe-4ef0-870c-206481f264dd', 'volume_name': 'volume-97bb0375-1ebe-4ef0-870c-206481f264dd', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5235d5-0f52-4ba5-9011-9ac7e4dab3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a5235d5-0f52-4ba5-9011-9ac7e4dab3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc0b676-2b0c-4c8c-99f9-17eea48b8c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:39 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Volume 97bb0375-1ebe-4ef0-870c-206481f264dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bb0375-1ebe-4ef0-870c-206481f264dd', 'volume_size': 1} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] creating volume v_97bb0375-1ebe-4ef0-870c-206481f264dd. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] create volume {'name': 'v_97bb0375-1ebe-4ef0-870c-206481f264dd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_97bb0375-1ebe-4ef0-870c-206481f264dd', 'is_clone': False, 'name': 'v_97bb0375-1ebe-4ef0-870c-206481f264dd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dc0b676-2b0c-4c8c-99f9-17eea48b8c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bb0375-1ebe-4ef0-870c-206481f264dd', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba1b587-78b4-49a5-8753-0633f1f94ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Volume volume-97bb0375-1ebe-4ef0-870c-206481f264dd (97bb0375-1ebe-4ef0-870c-206481f264dd): created successfully Apr 14 00:16:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba1b587-78b4-49a5-8753-0633f1f94ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Flow 'volume_create_manager' (e4ef2b80-a9b7-4991-9ce2-26343de2b0b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a5ae8fe4-ab80-4aeb-9a6d-24aef76d4e33 tempest-VolumesGetTest-1053284712 None] Created volume successfully. Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-97bb0375-1ebe-4ef0-870c-206481f264dd-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Lock "cinder-97bb0375-1ebe-4ef0-870c-206481f264dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] remove_export for volume: 97bb0375-1ebe-4ef0-870c-206481f264dd. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-286619410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=97bb0375-1ebe-4ef0-870c-206481f264dd,launched_at=2023-04-14T00:16:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP buWZVBDP 1uxR5qGnijIr3D',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:42Z,updated_at=2023-04-14T00:16:42Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] detach volume v_97bb0375-1ebe-4ef0-870c-206481f264dd from target iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd/luns/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd/luns/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd/luns/v_97bb0375-1ebe-4ef0-870c-206481f264dd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd/luns/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd because of JDSS resource v_97bb0375-1ebe-4ef0-870c-206481f264dd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd because of JDSS resource iqn.2010-10.org.openstack:97bb0375-1ebe-4ef0-870c-206481f264dd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] deleating volume v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] get volume v_97bb0375-1ebe-4ef0-870c-206481f264dd info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_97bb0375-1ebe-4ef0-870c-206481f264dd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432809', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108322', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7589681920524094844', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '39e36addc5885894', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341711872', 'san:volume_id': '39e36addc5885894fe0befd052206c4d0a21ab5d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78823', 'name': 'v_97bb0375-1ebe-4ef0-870c-206481f264dd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] delete volume:v_97bb0375-1ebe-4ef0-870c-206481f264dd recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_97bb0375-1ebe-4ef0-870c-206481f264dd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] volume v_97bb0375-1ebe-4ef0-870c-206481f264dd deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.quota [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Created reservations ['28fb0598-a391-4525-a44f-285d59f62aea', '1a2f43eb-8d46-450e-8b76-b2b8c43baea7', '0d6e4bd0-9d43-49a3-8506-c72070648126', '78aeeabd-d358-46e5-924e-75ba8a3bf00e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341793792', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.manager [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:44 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3855b218-f8a1-4e19-9627-59bb008493aa tempest-VolumesGetTest-1053284712 None] Lock "cinder-97bb0375-1ebe-4ef0-870c-206481f264dd-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Acquiring lock "cinder-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Lock "cinder-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] remove_export for volume: c29a3a7e-6e56-4393-97e5-0cf0cf92c3db. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:36Z,deleted=False,deleted_at=None,display_description='This is the new description of volume',display_name='tempest-VolumesGetTest-new-Volume-2139739765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c29a3a7e-6e56-4393-97e5-0cf0cf92c3db,launched_at=2023-04-14T00:16:38Z,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='40af22ab19184a9b9c696e73f7019809',provider_auth='CHAP LuDoBbQd R2ysfB5tQjiUSr',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:36Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:45Z,updated_at=2023-04-14T00:16:45Z,use_quota=True,user_id='ef5ee5cc20dd4d5184f1bad91c525209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] detach volume v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db from target iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/luns/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/luns/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/luns/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/luns/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db because of JDSS resource v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] delete target: iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] delete target iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] failed to remove resource iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db because of JDSS resource iqn.2010-10.org.openstack:c29a3a7e-6e56-4393-97e5-0cf0cf92c3db DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] deleating volume v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] get snapshots for volume v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] get volume v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432806', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108318', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4532034081727457130', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fec22048ee65b28d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341793792', 'san:volume_id': 'fec22048ee65b28d965fc887682f9cca17f79ff7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79709', 'name': 'v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] delete snapshot v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] snapshot v_c29a3a7e-6e56-4393-97e5-0cf0cf92c3db deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=29,cinder:SELECT=61,cinder:DELETE=2,cinder:INSERT=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:INSERT=13,cinder:SELECT=52,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.quota [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Created reservations ['fad91951-5ad0-4557-bbe8-153395e7bb3f', '91f673d4-0dc6-4b1c-b652-f501dee05942', '219e6eca-7728-4449-8251-8cebef74947c', 'ed54d362-bd2d-4006-9035-fcce13cb5d39'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341806080', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.manager [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Deleted volume successfully. Apr 14 00:16:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-92d5c19e-828c-4687-acfc-f74f6c00c149 tempest-VolumesGetTest-1053284712 None] Lock "cinder-c29a3a7e-6e56-4393-97e5-0cf0cf92c3db-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Flow 'volume_create_manager' (ee482567-7308-4e0f-8d2f-5e315fb6eeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5634985-732c-4992-b270-9453fe91dd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5634985-732c-4992-b270-9453fe91dd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1491387094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=69599ada-93d4-425a-ae12-e52cafcc29f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6be95e5c8d94269802ecf487ff73104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:48Z,use_quota=True,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c18f26b-4975-48c3-9d53-461f462ea278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c18f26b-4975-48c3-9d53-461f462ea278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a3411-da30-44b4-8e86-0fdc477715a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16a3411-da30-44b4-8e86-0fdc477715a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69599ada-93d4-425a-ae12-e52cafcc29f7', 'volume_name': 'volume-69599ada-93d4-425a-ae12-e52cafcc29f7', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d31b25d-7a7a-4113-ad23-6ac8d57f199a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d31b25d-7a7a-4113-ad23-6ac8d57f199a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667df381-cb25-4860-a838-d9fb7ec6605e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:48 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Volume 69599ada-93d4-425a-ae12-e52cafcc29f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69599ada-93d4-425a-ae12-e52cafcc29f7', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Cloning 69599ada-93d4-425a-ae12-e52cafcc29f7 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 16, 48, 290639)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 16, 48, 308328)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] create snapshot v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_69599ada-93d4-425a-ae12-e52cafcc29f7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] create volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 from snapshot v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (b435c41c-0c32-41f2-a379-56850e01007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8376903b-f5e4-4eec-b511-e6a69e0c4191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8376903b-f5e4-4eec-b511-e6a69e0c4191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1249323478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e25e528-7383-4ad3-a6ff-8c209015637c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:50Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5a9f40-50fb-450d-9c3e-dd4cfd50dbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5a9f40-50fb-450d-9c3e-dd4cfd50dbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3709a95c-cc5c-4df0-88a8-c4b47c6b0910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3709a95c-cc5c-4df0-88a8-c4b47c6b0910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e25e528-7383-4ad3-a6ff-8c209015637c', 'volume_name': 'volume-5e25e528-7383-4ad3-a6ff-8c209015637c', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfe211f-612f-49a0-94cc-3bf18220463c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfe211f-612f-49a0-94cc-3bf18220463c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b915ee2a-d73c-4fe4-a706-f4e949beecbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:49 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume 5e25e528-7383-4ad3-a6ff-8c209015637c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e25e528-7383-4ad3-a6ff-8c209015637c', 'volume_size': 1} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] creating volume v_5e25e528-7383-4ad3-a6ff-8c209015637c. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] create volume {'name': 'v_5e25e528-7383-4ad3-a6ff-8c209015637c', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'is_clone': True, 'full_name': 'Pool-0/v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'name': 'v_69599ada-93d4-425a-ae12-e52cafcc29f7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] get volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432819', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108331', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4203884528210042509', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f07f5a89696aa3f5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341724160', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79313', 'name': 'v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Marking volume 69599ada-93d4-425a-ae12-e52cafcc29f7 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Creating volume glance metadata for volume 69599ada-93d4-425a-ae12-e52cafcc29f7 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667df381-cb25-4860-a838-d9fb7ec6605e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69599ada-93d4-425a-ae12-e52cafcc29f7', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69687fec-871f-429e-8f26-5ef915de6775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Volume volume-69599ada-93d4-425a-ae12-e52cafcc29f7 (69599ada-93d4-425a-ae12-e52cafcc29f7): created successfully Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69687fec-871f-429e-8f26-5ef915de6775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Flow 'volume_create_manager' (ee482567-7308-4e0f-8d2f-5e315fb6eeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-331b1c88-9c40-433a-861e-70319755ab23 tempest-TestShelveInstance-5222591 None] Created volume successfully. Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5e25e528-7383-4ad3-a6ff-8c209015637c', 'is_clone': False, 'name': 'v_5e25e528-7383-4ad3-a6ff-8c209015637c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b915ee2a-d73c-4fe4-a706-f4e949beecbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e25e528-7383-4ad3-a6ff-8c209015637c', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f1217f-0846-48fb-bac3-b574a712ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume volume-5e25e528-7383-4ad3-a6ff-8c209015637c (5e25e528-7383-4ad3-a6ff-8c209015637c): created successfully Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f1217f-0846-48fb-bac3-b574a712ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (b435c41c-0c32-41f2-a379-56850e01007a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-db93ecf2-2394-4de7-bd35-96101b058b45 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created volume successfully. Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (e6c806a0-397d-45b7-98d0-bbee6b18f306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4396c99d-9aec-4cae-960a-ad57e541b0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4396c99d-9aec-4cae-960a-ad57e541b0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476933489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=84dc0c36-f2cf-4152-a7ef-ef743c72ddd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:51Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0fec56-f819-4689-999f-fa5282cf822d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f0fec56-f819-4689-999f-fa5282cf822d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e3165-d7ca-4b70-b421-5c7523bf0b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278e3165-d7ca-4b70-b421-5c7523bf0b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'volume_name': 'volume-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5f8033-ff60-4bd8-bf99-26370ab236b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5f8033-ff60-4bd8-bf99-26370ab236b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7260667b-3ec7-4247-906d-ad86cf20f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume 84dc0c36-f2cf-4152-a7ef-ef743c72ddd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'volume_size': 1} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] creating volume v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] create volume {'name': 'v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (d1e52f2f-b276-46b4-8544-c0376e6e69e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f37d199-66f0-42f1-b14a-a663c5aed3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f37d199-66f0-42f1-b14a-a663c5aed3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978466527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ef4ec505-98da-4aa0-97bb-1eda725bdef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:51Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c92a1a5-8030-4af6-a53c-ed1c17f6b0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c92a1a5-8030-4af6-a53c-ed1c17f6b0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1145ee40-85e5-47c4-b4ff-61f18cba1285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1145ee40-85e5-47c4-b4ff-61f18cba1285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'volume_name': 'volume-ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39fa1e5-02fe-4d4b-9c97-1df9a3332efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d39fa1e5-02fe-4d4b-9c97-1df9a3332efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a5f25d-32d3-48da-a48c-74480bb734a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume ef4ec505-98da-4aa0-97bb-1eda725bdef9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'volume_size': 1} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] creating volume v_ef4ec505-98da-4aa0-97bb-1eda725bdef9. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] create volume {'name': 'v_ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (d2d421f1-29c6-4a57-bb83-6e201488e424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fda1f9e-c914-49bb-9b19-495ed714a5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fda1f9e-c914-49bb-9b19-495ed714a5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673135674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b06ab290-8569-46fc-976f-5a4bf0b34d38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:51Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802ec9cd-c38b-49f0-8019-b16a2ceddeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802ec9cd-c38b-49f0-8019-b16a2ceddeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b14f70-5343-4a29-930f-7f4199f20317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b14f70-5343-4a29-930f-7f4199f20317) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b06ab290-8569-46fc-976f-5a4bf0b34d38', 'volume_name': 'volume-b06ab290-8569-46fc-976f-5a4bf0b34d38', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f6ee95-0a04-40c8-ac31-8e63e35da0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f6ee95-0a04-40c8-ac31-8e63e35da0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c645d9-0ab3-4cb8-b095-fbf6237ff69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume b06ab290-8569-46fc-976f-5a4bf0b34d38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b06ab290-8569-46fc-976f-5a4bf0b34d38', 'volume_size': 1} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] creating volume v_b06ab290-8569-46fc-976f-5a4bf0b34d38. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] create volume {'name': 'v_b06ab290-8569-46fc-976f-5a4bf0b34d38', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'is_clone': False, 'name': 'v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7260667b-3ec7-4247-906d-ad86cf20f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fedeff-d736-4583-9b19-e650055c8b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume volume-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 (84dc0c36-f2cf-4152-a7ef-ef743c72ddd4): created successfully Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fedeff-d736-4583-9b19-e650055c8b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (e6c806a0-397d-45b7-98d0-bbee6b18f306) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2592c84b-c9eb-480b-9eea-7411eabd693d tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created volume successfully. Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (255245f9-7d0c-4f4e-9fab-9b9befdae38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9448ae30-8b18-4478-a243-5e7994250a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9448ae30-8b18-4478-a243-5e7994250a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057690327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=659b2635-2ad8-499f-81a2-b0318c34c248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:52Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd0d98d-6fc5-4280-a8cb-cdc42d917e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bd0d98d-6fc5-4280-a8cb-cdc42d917e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047bff07-bf5f-4f8f-bee7-f26fb1deee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047bff07-bf5f-4f8f-bee7-f26fb1deee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659b2635-2ad8-499f-81a2-b0318c34c248', 'volume_name': 'volume-659b2635-2ad8-499f-81a2-b0318c34c248', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8264579-5a62-4ca3-a808-dc5c0d39cbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8264579-5a62-4ca3-a808-dc5c0d39cbd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c50212-5976-4f26-a014-efdfb8387cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume 659b2635-2ad8-499f-81a2-b0318c34c248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659b2635-2ad8-499f-81a2-b0318c34c248', 'volume_size': 1} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] creating volume v_659b2635-2ad8-499f-81a2-b0318c34c248. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] create volume {'name': 'v_659b2635-2ad8-499f-81a2-b0318c34c248', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'is_clone': False, 'name': 'v_ef4ec505-98da-4aa0-97bb-1eda725bdef9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a5f25d-32d3-48da-a48c-74480bb734a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f41e2d1-38bd-466d-b196-b2d2259cf74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume volume-ef4ec505-98da-4aa0-97bb-1eda725bdef9 (ef4ec505-98da-4aa0-97bb-1eda725bdef9): created successfully Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f41e2d1-38bd-466d-b196-b2d2259cf74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (d1e52f2f-b276-46b4-8544-c0376e6e69e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-155fc6b2-3144-44fb-9f68-103383a39103 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created volume successfully. Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (3997a994-96d8-4588-995c-8f200bd1f259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8e2358-ef9d-45cd-af62-a95ca5a1d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db8e2358-ef9d-45cd-af62-a95ca5a1d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177661485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b123d9dd-e724-4f76-b734-06fc9135841e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:16:52Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ceb0a7-7db2-4ea2-bcd7-8be52e9f4ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ceb0a7-7db2-4ea2-bcd7-8be52e9f4ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b174440-2fe6-4adc-aa9f-adf8d0787b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b174440-2fe6-4adc-aa9f-adf8d0787b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b123d9dd-e724-4f76-b734-06fc9135841e', 'volume_name': 'volume-b123d9dd-e724-4f76-b734-06fc9135841e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93d1ba2-b0cb-468e-a58c-8500cf43bffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93d1ba2-b0cb-468e-a58c-8500cf43bffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c0c7a0-908d-4743-971c-2e663908abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume b123d9dd-e724-4f76-b734-06fc9135841e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b123d9dd-e724-4f76-b734-06fc9135841e', 'volume_size': 1} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] creating volume v_b123d9dd-e724-4f76-b734-06fc9135841e. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] create volume {'name': 'v_b123d9dd-e724-4f76-b734-06fc9135841e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b06ab290-8569-46fc-976f-5a4bf0b34d38', 'is_clone': False, 'name': 'v_b06ab290-8569-46fc-976f-5a4bf0b34d38'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c645d9-0ab3-4cb8-b095-fbf6237ff69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b06ab290-8569-46fc-976f-5a4bf0b34d38', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940d2e3f-ba04-4832-9fa5-07119295d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume volume-b06ab290-8569-46fc-976f-5a4bf0b34d38 (b06ab290-8569-46fc-976f-5a4bf0b34d38): created successfully Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940d2e3f-ba04-4832-9fa5-07119295d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (d2d421f1-29c6-4a57-bb83-6e201488e424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f6c695a9-37c0-4c51-bf51-c9baa32a192b tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created volume successfully. Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_659b2635-2ad8-499f-81a2-b0318c34c248', 'is_clone': False, 'name': 'v_659b2635-2ad8-499f-81a2-b0318c34c248'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c50212-5976-4f26-a014-efdfb8387cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659b2635-2ad8-499f-81a2-b0318c34c248', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a689f9-7a1e-4b50-b6cf-74c87d1ca53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume volume-659b2635-2ad8-499f-81a2-b0318c34c248 (659b2635-2ad8-499f-81a2-b0318c34c248): created successfully Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7a689f9-7a1e-4b50-b6cf-74c87d1ca53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (255245f9-7d0c-4f4e-9fab-9b9befdae38c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8cd4903c-c894-4184-a78c-ecf37915239e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created volume successfully. Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b123d9dd-e724-4f76-b734-06fc9135841e', 'is_clone': False, 'name': 'v_b123d9dd-e724-4f76-b734-06fc9135841e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2c0c7a0-908d-4743-971c-2e663908abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b123d9dd-e724-4f76-b734-06fc9135841e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbaa4665-4654-4a17-a006-3bb81b15926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:16:53 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Volume volume-b123d9dd-e724-4f76-b734-06fc9135841e (b123d9dd-e724-4f76-b734-06fc9135841e): created successfully Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbaa4665-4654-4a17-a006-3bb81b15926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Flow 'volume_create_manager' (3997a994-96d8-4588-995c-8f200bd1f259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:16:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a4c10816-604b-49ae-bfe7-d123b30445d2 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created volume successfully. Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Acquiring lock "cinder-b123d9dd-e724-4f76-b734-06fc9135841e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-b123d9dd-e724-4f76-b734-06fc9135841e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=65,cinder:INSERT=7,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove_export for volume: b123d9dd-e724-4f76-b734-06fc9135841e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177661485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b123d9dd-e724-4f76-b734-06fc9135841e,launched_at=2023-04-14T00:16:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth='CHAP MpALizRl lYsHeUfuZ6v4Gb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:54Z,updated_at=2023-04-14T00:16:54Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume v_b123d9dd-e724-4f76-b734-06fc9135841e from target iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e/luns/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e/luns/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e/luns/v_b123d9dd-e724-4f76-b734-06fc9135841e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e/luns/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e because of JDSS resource v_b123d9dd-e724-4f76-b734-06fc9135841e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target: iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e because of JDSS resource iqn.2010-10.org.openstack:b123d9dd-e724-4f76-b734-06fc9135841e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] deleating volume v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get snapshots for volume v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get volume v_b123d9dd-e724-4f76-b734-06fc9135841e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] create export for volume: 69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] ensure volume 69599ada-93d4-425a-ae12-e52cafcc29f7 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] check if targe iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b123d9dd-e724-4f76-b734-06fc9135841e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432822', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108354', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14992847616081397626', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4500170a7b158426', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341302272', 'san:volume_id': '4500170a7b15842643d793d498060d80b5723472', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79881', 'name': 'v_b123d9dd-e724-4f76-b734-06fc9135841e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete volume:v_b123d9dd-e724-4f76-b734-06fc9135841e recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] create target and attach volume 69599ada-93d4-425a-ae12-e52cafcc29f7 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] create target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b123d9dd-e724-4f76-b734-06fc9135841e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] volume v_b123d9dd-e724-4f76-b734-06fc9135841e deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.quota [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created reservations ['ed716c31-7e6f-4651-9418-f8595bd22f80', 'aa9faac0-16ef-4091-8b7f-b4e261bfc18d', '998d0bf9-c2c6-4567-b67c-0e484f610ed0', '65c0f9fc-5117-4074-a311-cd80bde2122b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341359616', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.manager [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:56 user cinder-volume[84560]: INFO cinder.volume.manager [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Deleted volume successfully. Apr 14 00:16:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=32,cinder:SELECT=52,cinder:DELETE=5,cinder:INSERT=11 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-916a629b-1939-4ccb-b2fe-a1fd92e613b9 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-b123d9dd-e724-4f76-b734-06fc9135841e-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Acquiring lock "cinder-659b2635-2ad8-499f-81a2-b0318c34c248-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-659b2635-2ad8-499f-81a2-b0318c34c248-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove_export for volume: 659b2635-2ad8-499f-81a2-b0318c34c248. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1057690327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=659b2635-2ad8-499f-81a2-b0318c34c248,launched_at=2023-04-14T00:16:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth='CHAP yBauHLwr kIP5NocQl1mYMu',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:16:57Z,updated_at=2023-04-14T00:16:57Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume v_659b2635-2ad8-499f-81a2-b0318c34c248 from target iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248/luns/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248/luns/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248/luns/v_659b2635-2ad8-499f-81a2-b0318c34c248'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248/luns/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 because of JDSS resource v_659b2635-2ad8-499f-81a2-b0318c34c248 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target: iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] atach volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 to target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 because of JDSS resource iqn.2010-10.org.openstack:659b2635-2ad8-499f-81a2-b0318c34c248 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] deleating volume v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get snapshots for volume v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get volume v_659b2635-2ad8-499f-81a2-b0318c34c248 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_659b2635-2ad8-499f-81a2-b0318c34c248', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432822', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108350', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16811597794671144273', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c609548bbfcffb89', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341359616', 'san:volume_id': 'c609548bbfcffb8919b4ea9c200179c8a14f848f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79872', 'name': 'v_659b2635-2ad8-499f-81a2-b0318c34c248', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete volume:v_659b2635-2ad8-499f-81a2-b0318c34c248 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6630376635613839', 'lun': 0, 'mode': 'wt', 'name': 'v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'prod_id': 'Storage', 'scsi_id': 'f07f5a89696aa3f5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] add credentails to target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Geting {'code': 201, 'error': None, 'data': {'name': 'FZCpIqMc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] initialize_connection for 69599ada-93d4-425a-ae12-e52cafcc29f7 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:16:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '1cf6ab58-ea49-4409-8a5b-bbc6e23cbce0'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:16:58 user cinder-volume[84560]: INFO cinder.volume.manager [req-6a38e78e-8e13-405b-8ed3-237d1b6d0204 req-32169007-948e-48e6-b2da-f2ef6df95219 tempest-TestShelveInstance-5222591 None] attachment_update completed successfully. Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_659b2635-2ad8-499f-81a2-b0318c34c248 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] volume v_659b2635-2ad8-499f-81a2-b0318c34c248 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.quota [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created reservations ['c96a5016-f210-4e9a-9bb3-1db99c8a44a4', '8c96f518-2d1b-4af8-9418-ae8465196fba', '9982227b-9ce3-4c14-823a-e82cb1c9e169', 'e8a3aa96-016e-4a9b-99a8-3d209c2153ab'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341453824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.manager [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:16:59 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Deleted volume successfully. Apr 14 00:16:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9e1ad0ad-730d-48e3-ad89-a12602af7de3 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-659b2635-2ad8-499f-81a2-b0318c34c248-delete_volume" released by "delete_volume" :: held 3.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Acquiring lock "cinder-b06ab290-8569-46fc-976f-5a4bf0b34d38-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-b06ab290-8569-46fc-976f-5a4bf0b34d38-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove_export for volume: b06ab290-8569-46fc-976f-5a4bf0b34d38. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-673135674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b06ab290-8569-46fc-976f-5a4bf0b34d38,launched_at=2023-04-14T00:16:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth='CHAP SXObQYTz CPRQnULZ48uabX',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:17:00Z,updated_at=2023-04-14T00:17:00Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume v_b06ab290-8569-46fc-976f-5a4bf0b34d38 from target iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38/luns/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38/luns/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38/luns/v_b06ab290-8569-46fc-976f-5a4bf0b34d38'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38/luns/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 because of JDSS resource v_b06ab290-8569-46fc-976f-5a4bf0b34d38 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target: iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 because of JDSS resource iqn.2010-10.org.openstack:b06ab290-8569-46fc-976f-5a4bf0b34d38 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] deleating volume v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get snapshots for volume v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get volume v_b06ab290-8569-46fc-976f-5a4bf0b34d38 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b06ab290-8569-46fc-976f-5a4bf0b34d38', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432821', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108347', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17084054981531882178', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '20ff8761bcbbb112', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341453824', 'san:volume_id': '20ff8761bcbbb1124c48c24b538226eb394a686d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79351', 'name': 'v_b06ab290-8569-46fc-976f-5a4bf0b34d38', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete volume:v_b06ab290-8569-46fc-976f-5a4bf0b34d38 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b06ab290-8569-46fc-976f-5a4bf0b34d38 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] volume v_b06ab290-8569-46fc-976f-5a4bf0b34d38 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.quota [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created reservations ['e9c61a47-4c39-493a-90cf-36c5e1721188', '8f5cfe6c-674e-4b11-a122-777ac973a6e9', 'f6e84d56-fe44-4a90-9da5-b2f32b09a6e2', '4d9c5652-32a0-4233-8443-f9563e828009'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341535744', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.manager [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:17:03 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Deleted volume successfully. Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6dcf7326-1373-4904-84c6-cc35a95e86a7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-b06ab290-8569-46fc-976f-5a4bf0b34d38-delete_volume" released by "delete_volume" :: held 2.962s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Acquiring lock "cinder-ef4ec505-98da-4aa0-97bb-1eda725bdef9-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-ef4ec505-98da-4aa0-97bb-1eda725bdef9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove_export for volume: ef4ec505-98da-4aa0-97bb-1eda725bdef9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-978466527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ef4ec505-98da-4aa0-97bb-1eda725bdef9,launched_at=2023-04-14T00:16:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth='CHAP KSvyxCRN SwMkUNGidCq0EH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:17:03Z,updated_at=2023-04-14T00:17:03Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 from target iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9/luns/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9/luns/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9/luns/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9/luns/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 because of JDSS resource v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target: iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 because of JDSS resource iqn.2010-10.org.openstack:ef4ec505-98da-4aa0-97bb-1eda725bdef9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] deleating volume v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get snapshots for volume v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get volume v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432821', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108342', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5395367300109135738', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f9e31780195483e8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341535744', 'san:volume_id': 'f9e31780195483e81a6c88a2351a5b4da8876810', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79341', 'name': 'v_ef4ec505-98da-4aa0-97bb-1eda725bdef9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete volume:v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] volume v_ef4ec505-98da-4aa0-97bb-1eda725bdef9 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.quota [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created reservations ['e517ec68-e598-4699-8eeb-c2fe414301cf', 'd0bce78a-d15e-47b0-b761-200ed62a98c8', '6b410a6d-5f0e-4b75-b616-25991edc5750', 'e8425632-9134-403a-9b28-e1653b8f3a17'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=54,cinder:INSERT=7,cinder:UPDATE=36,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341617664', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.manager [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:17:06 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Deleted volume successfully. Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3cf64e43-605b-4d3f-b864-3b88b24635f7 tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-ef4ec505-98da-4aa0-97bb-1eda725bdef9-delete_volume" released by "delete_volume" :: held 3.061s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Acquiring lock "cinder-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove_export for volume: 84dc0c36-f2cf-4152-a7ef-ef743c72ddd4. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476933489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=84dc0c36-f2cf-4152-a7ef-ef743c72ddd4,launched_at=2023-04-14T00:16:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth='CHAP DXhTaNrP lpDjz1mVC8kMSJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:17:07Z,updated_at=2023-04-14T00:17:07Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 from target iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/luns/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/luns/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/luns/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/luns/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 because of JDSS resource v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target: iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 because of JDSS resource iqn.2010-10.org.openstack:84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] deleating volume v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get snapshots for volume v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get volume v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432821', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108339', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15274777658960207979', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0537e85fb74879dd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341617664', 'san:volume_id': '0537e85fb74879dd1a8c4669c151688bd631c44c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79333', 'name': 'v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete volume:v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] volume v_84dc0c36-f2cf-4152-a7ef-ef743c72ddd4 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.quota [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created reservations ['293c9491-63ae-4a74-a412-449b92481828', '4551705c-d770-43e1-bc0c-da0521a49195', '51254cd3-c54a-42d3-8ba5-78ab0fd7e7db', '20308c20-4168-4e24-83a0-e46a46250dd4'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341675008', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.manager [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:17:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Deleted volume successfully. Apr 14 00:17:09 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=62,cinder:UPDATE=27,cinder:INSERT=10,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b3d53dc5-2cd6-444c-a031-10e0396dcdce tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-84dc0c36-f2cf-4152-a7ef-ef743c72ddd4-delete_volume" released by "delete_volume" :: held 2.920s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Acquiring lock "cinder-5e25e528-7383-4ad3-a6ff-8c209015637c-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-5e25e528-7383-4ad3-a6ff-8c209015637c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove_export for volume: 5e25e528-7383-4ad3-a6ff-8c209015637c. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1249323478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5e25e528-7383-4ad3-a6ff-8c209015637c,launched_at=2023-04-14T00:16:51Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f45cfb67b64d0dac3af811fac3f9ab',provider_auth='CHAP QDmAWovj eqAJsONtMRH76Q',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:50Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:17:10Z,updated_at=2023-04-14T00:17:10Z,use_quota=True,user_id='0e0b57509cae4149a2195feccfee3512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] detach volume v_5e25e528-7383-4ad3-a6ff-8c209015637c from target iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c/luns/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c/luns/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c/luns/v_5e25e528-7383-4ad3-a6ff-8c209015637c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c/luns/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c because of JDSS resource v_5e25e528-7383-4ad3-a6ff-8c209015637c DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target: iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete target iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] failed to remove resource iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c because of JDSS resource iqn.2010-10.org.openstack:5e25e528-7383-4ad3-a6ff-8c209015637c DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] deleating volume v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get snapshots for volume v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] get volume v_5e25e528-7383-4ad3-a6ff-8c209015637c info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5e25e528-7383-4ad3-a6ff-8c209015637c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432819', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108334', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12737719059980947861', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '549b73966f9dc0cb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114341675008', 'san:volume_id': '549b73966f9dc0cb2de387a1df164f90399ccd34', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79323', 'name': 'v_5e25e528-7383-4ad3-a6ff-8c209015637c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] delete volume:v_5e25e528-7383-4ad3-a6ff-8c209015637c recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5e25e528-7383-4ad3-a6ff-8c209015637c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] volume v_5e25e528-7383-4ad3-a6ff-8c209015637c deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.quota [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Created reservations ['0c36d7a3-91e5-40b4-8830-8693c0d89b4e', '4c47ecfa-38f4-4bcf-b72b-5020294f3825', 'c1382cff-a8c3-4789-bc16-c2dc7aba2aef', '8f64a84d-b866-45cf-b4a4-c185973b066b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Geting {'code': 200, 'error': None, 'data': {'available': '114341781504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.manager [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:17:12 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Deleted volume successfully. Apr 14 00:17:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-9b38b319-0993-4057-850b-a1b333fd6a9e tempest-CreateVolumesFromSourceVolumeTest-1511522879 None] Lock "cinder-5e25e528-7383-4ad3-a6ff-8c209015637c-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Flow 'volume_create_manager' (bc2028dd-931d-43e7-9b5b-fc4f6826a300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6d7b2f-cf05-4f77-964f-f8ff7b756f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a6d7b2f-cf05-4f77-964f-f8ff7b756f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-726511793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=89a24f9a-783f-4d14-8413-4fb61263665e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:17:15Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c0da70-0b96-487a-98c8-06f85d04061a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41c0da70-0b96-487a-98c8-06f85d04061a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde30b48-4585-476c-b0b8-cde83bc6505e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cde30b48-4585-476c-b0b8-cde83bc6505e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a24f9a-783f-4d14-8413-4fb61263665e', 'volume_name': 'volume-89a24f9a-783f-4d14-8413-4fb61263665e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54d1510-bd43-49e9-8d0e-b1ab1cf20fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b54d1510-bd43-49e9-8d0e-b1ab1cf20fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fced5f56-9200-4351-9dd2-1ae841ed0b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:15 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Volume 89a24f9a-783f-4d14-8413-4fb61263665e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a24f9a-783f-4d14-8413-4fb61263665e', 'volume_size': 1} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] creating volume v_89a24f9a-783f-4d14-8413-4fb61263665e. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] create volume {'name': 'v_89a24f9a-783f-4d14-8413-4fb61263665e', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_89a24f9a-783f-4d14-8413-4fb61263665e', 'is_clone': False, 'name': 'v_89a24f9a-783f-4d14-8413-4fb61263665e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fced5f56-9200-4351-9dd2-1ae841ed0b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a24f9a-783f-4d14-8413-4fb61263665e', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1726cfaf-ec13-43b5-b73c-dd4bc30891c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Volume volume-89a24f9a-783f-4d14-8413-4fb61263665e (89a24f9a-783f-4d14-8413-4fb61263665e): created successfully Apr 14 00:17:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1726cfaf-ec13-43b5-b73c-dd4bc30891c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Flow 'volume_create_manager' (bc2028dd-931d-43e7-9b5b-fc4f6826a300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:17:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-dcc54a2b-8fd0-4cdb-ae56-9f2cab2ae586 tempest-AttachVolumeTestJSON-1885059489 None] Created volume successfully. Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Flow 'volume_create_manager' (b0585eb8-6a20-4a12-bff7-8288fed1eaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdc89cc-bb9e-4eb8-8387-7e162323e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fdc89cc-bb9e-4eb8-8387-7e162323e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2681b171-ba2b-44b0-8a6a-e89a52fafc99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3f111e24414976beddba7ef90c4793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:17:18Z,use_quota=True,user_id='90bad96535c3453792982c5acab9dbc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c465be-d69e-4a16-8b30-ae74d549531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29c465be-d69e-4a16-8b30-ae74d549531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9341b146-ee5f-4c06-8f93-0bdd51365600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9341b146-ee5f-4c06-8f93-0bdd51365600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'volume_name': 'volume-2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f62dde6-e397-47d0-8a4d-b67b1b060fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f62dde6-e397-47d0-8a4d-b67b1b060fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73595643-d972-4ff7-a162-d87b73cc7fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:17 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Volume 2681b171-ba2b-44b0-8a6a-e89a52fafc99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Cloning 2681b171-ba2b-44b0-8a6a-e89a52fafc99 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.coordination [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:17 user cinder-volume[84560]: DEBUG cinder.coordination [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.053s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.image.cache [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 17, 17, 992821)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.image.cache [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.coordination [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.046s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.image.cache [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 17, 18, 34153)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.image.cache [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] create export for volume: 89a24f9a-783f-4d14-8413-4fb61263665e. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] ensure volume 89a24f9a-783f-4d14-8413-4fb61263665e assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] check if targe iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create snapshot v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] create target and attach volume 89a24f9a-783f-4d14-8413-4fb61263665e to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] create target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_2681b171-ba2b-44b0-8a6a-e89a52fafc99'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create volume v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 from snapshot v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:17:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'is_clone': True, 'full_name': 'Pool-0/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'name': 'v_2681b171-ba2b-44b0-8a6a-e89a52fafc99'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] get volume v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432849', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108376', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3067828042203533087', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b6ffc10fc04ade19', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331500544', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79395', 'name': 'v_2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Marking volume 2681b171-ba2b-44b0-8a6a-e89a52fafc99 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 2681b171-ba2b-44b0-8a6a-e89a52fafc99. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Creating volume glance metadata for volume 2681b171-ba2b-44b0-8a6a-e89a52fafc99 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73595643-d972-4ff7-a162-d87b73cc7fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71124963-f7ee-42c5-a059-c560f1fca55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:20 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Volume volume-2681b171-ba2b-44b0-8a6a-e89a52fafc99 (2681b171-ba2b-44b0-8a6a-e89a52fafc99): created successfully Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71124963-f7ee-42c5-a059-c560f1fca55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Flow 'volume_create_manager' (b0585eb8-6a20-4a12-bff7-8288fed1eaa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:17:20 user cinder-volume[84560]: INFO cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-eb2410aa-33a2-4493-80a2-89baec642494 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Created volume successfully. Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] atach volume v_89a24f9a-783f-4d14-8413-4fb61263665e to target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331488256', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:17:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6664353764633864', 'lun': 0, 'mode': 'wt', 'name': 'v_89a24f9a-783f-4d14-8413-4fb61263665e', 'prod_id': 'Storage', 'scsi_id': 'fd57dc8d96e8e901'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] add credentails to target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'name': 'qzxBPYXt'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] initialize_connection for 89a24f9a-783f-4d14-8413-4fb61263665e 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:17:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qzxBPYXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'bc4f1100-cf47-442c-a1d6-2c5f41524bc6'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:17:22 user cinder-volume[84560]: INFO cinder.volume.manager [req-11abbb7d-b787-4238-8274-e10babab4fd8 req-558de02a-5006-43e4-a849-131b7b81b1ff tempest-AttachVolumeTestJSON-1885059489 None] attachment_update completed successfully. Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create export for volume: 2681b171-ba2b-44b0-8a6a-e89a52fafc99. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] ensure volume 2681b171-ba2b-44b0-8a6a-e89a52fafc99 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] check if targe iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create target and attach volume 2681b171-ba2b-44b0-8a6a-e89a52fafc99 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] create target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] atach volume v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 to target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Flow 'volume_create_manager' (b7164912-2824-448d-8b80-bb8be673ef32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e40920-1972-4747-ae5e-f56a8ee1cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=56,cinder:INSERT=11,cinder:UPDATE=30,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e40920-1972-4747-ae5e-f56a8ee1cf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1137683442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7501233-eeb6-4ef4-8e07-4f0b28e2f902,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:17:26Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a98e801-f677-4bda-9cb1-7e0fe5f4d948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a98e801-f677-4bda-9cb1-7e0fe5f4d948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ddac36-c83d-4abd-bde3-72f301e23e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ddac36-c83d-4abd-bde3-72f301e23e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'volume_name': 'volume-a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7ce405-2f1c-420b-9d48-2a4cc56d0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c7ce405-2f1c-420b-9d48-2a4cc56d0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8cbca1-4162-49ff-8182-7b0dc3bec4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Volume a7501233-eeb6-4ef4-8e07-4f0b28e2f902: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'volume_size': 1} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] creating volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] create volume {'name': 'v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'is_clone': False, 'name': 'v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8cbca1-4162-49ff-8182-7b0dc3bec4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03afae84-e046-4dd6-930c-d46bf8833afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:17:27 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Volume volume-a7501233-eeb6-4ef4-8e07-4f0b28e2f902 (a7501233-eeb6-4ef4-8e07-4f0b28e2f902): created successfully Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03afae84-e046-4dd6-930c-d46bf8833afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Flow 'volume_create_manager' (b7164912-2824-448d-8b80-bb8be673ef32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6236666663313066', 'lun': 0, 'mode': 'wt', 'name': 'v_2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'prod_id': 'Storage', 'scsi_id': 'b6ffc10fc04ade19'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] add credentails to target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b32618b0-07dd-4e1a-90d7-454665ada81e tempest-AttachVolumeTestJSON-1885059489 None] Created volume successfully. Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 201, 'error': None, 'data': {'name': 'NhaiJkPC'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] initialize_connection for 2681b171-ba2b-44b0-8a6a-e89a52fafc99 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:17:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NhaiJkPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '9e5814ce-b181-44ee-877c-53333941f6ac'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:17:27 user cinder-volume[84560]: INFO cinder.volume.manager [req-d8df7363-6483-46a8-94a1-36b8251714a6 req-fb2a4728-6193-4269-adce-c600dbecbab6 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] attachment_update completed successfully. Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] create export for volume: a7501233-eeb6-4ef4-8e07-4f0b28e2f902. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] ensure volume a7501233-eeb6-4ef4-8e07-4f0b28e2f902 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] check if targe iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] create target and attach volume a7501233-eeb6-4ef4-8e07-4f0b28e2f902 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] create target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] atach volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 to target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:17:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6163373766343464', 'lun': 0, 'mode': 'wt', 'name': 'v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'prod_id': 'Storage', 'scsi_id': 'ac77f44de00b08be'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] add credentails to target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 201, 'error': None, 'data': {'name': 'PtALrNGE'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] initialize_connection for a7501233-eeb6-4ef4-8e07-4f0b28e2f902 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PtALrNGE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '359c9192-9e2e-4708-b343-be97a3461fd8'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:17:32 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=72,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:17:32 user cinder-volume[84560]: INFO cinder.volume.manager [req-9fb16364-c4b8-448e-bb86-ca7c6ac9b16c req-02345191-8126-414c-bd54-90ab3505ebfa tempest-AttachVolumeTestJSON-1885059489 None] attachment_update completed successfully. Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] terminate connection for 89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:17:37 user cinder-volume[84560]: INFO cinder.volume.manager [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Terminate volume connection completed successfully. Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Deleting attachment bc4f1100-cf47-442c-a1d6-2c5f41524bc6. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] remove_export for volume: 89a24f9a-783f-4d14-8413-4fb61263665e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-726511793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=89a24f9a-783f-4d14-8413-4fb61263665e,launched_at=2023-04-14T00:17:17Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth='CHAP qzxBPYXt HXI7xbhJ1Gd2Nq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:17:36Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] detach volume v_89a24f9a-783f-4d14-8413-4fb61263665e from target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] delete target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] delete target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-e9728202-9ea9-4697-94ff-103e11e339e5 req-6bb22b1f-f06c-4495-a5e2-c0909aeb06c9 tempest-AttachVolumeTestJSON-1885059489 None] target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] terminate connection for a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:17:39 user cinder-volume[84560]: INFO cinder.volume.manager [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Terminate volume connection completed successfully. Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Deleting attachment 359c9192-9e2e-4708-b343-be97a3461fd8. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] remove_export for volume: a7501233-eeb6-4ef4-8e07-4f0b28e2f902. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1137683442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7501233-eeb6-4ef4-8e07-4f0b28e2f902,launched_at=2023-04-14T00:17:27Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth='CHAP PtALrNGE D9SvxyrRlQ3Ykt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:17:39Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] detach volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 from target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] delete target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] delete target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b4104ceb-7e1f-45c9-b527-4542b81adec4 req-2733dd60-f062-4d83-961b-27666c238342 tempest-AttachVolumeTestJSON-1885059489 None] target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ae1d5e1e-d41c-440b-8abc-191e5231dda9 tempest-VolumesActionsTest-422643142 None] Acquiring lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9" by "attach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ae1d5e1e-d41c-440b-8abc-191e5231dda9 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9" acquired by "attach_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ae1d5e1e-d41c-440b-8abc-191e5231dda9 tempest-VolumesActionsTest-422643142 None] Attaching volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 to instance 02f97792-efc1-4976-bde1-70d7f9047cb5 at mountpoint /dev/vdb on host None. Apr 14 00:17:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ae1d5e1e-d41c-440b-8abc-191e5231dda9 tempest-VolumesActionsTest-422643142 None] Attach volume completed successfully. Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ae1d5e1e-d41c-440b-8abc-191e5231dda9 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9" released by "attach_volume" :: held 0.198s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Acquiring lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-detach_volume" by "detach_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:17:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Detaching volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 from instance 02f97792-efc1-4976-bde1-70d7f9047cb5. Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] remove_export for volume: 6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711029289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cafbda8-d881-4ce4-b77f-a22e606d9ac9,launched_at=2023-04-14T00:13:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e9bf71f0644907979ec775c62a0b39',provider_auth='CHAP suTbmgUi f9v0LCHDY34Qes',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:17:52Z,use_quota=True,user_id='719f2342cc1d452daae3a4ded790f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] detach volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 from target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] failed to remove resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 because of JDSS resource v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] delete target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] delete target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] failed to remove resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 because of JDSS resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:17:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Detach volume completed successfully. Apr 14 00:17:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-12cd6493-ea56-48be-b59b-aeb4fadfbd70 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:18:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=12,cinder:SELECT=47 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:INSERT=2,cinder:UPDATE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321203200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:18:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Flow 'volume_create_manager' (9b6f3aaf-5424-4492-9ec6-a1ae8dce7123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f60017-637c-4b87-b78c-3a0b301e2cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f60017-637c-4b87-b78c-3a0b301e2cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-700982832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0c953a4d-d77b-4d17-bcad-ea49b45adbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524265958bd24a6cb94aa3115eb2b6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:18:24Z,use_quota=True,user_id='f43f3171ccad4167ac783bbdfe2df478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e526f440-050b-4049-a7fc-d9e3d1c2e24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e526f440-050b-4049-a7fc-d9e3d1c2e24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c960f2-c6bf-4a5a-bd4c-9f56c9a2939c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9c960f2-c6bf-4a5a-bd4c-9f56c9a2939c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'volume_name': 'volume-0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61d9b30-e1b9-4438-9585-b20a9a55ecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61d9b30-e1b9-4438-9585-b20a9a55ecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c3630e-67ca-4a09-9975-66944ed8d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Volume 0c953a4d-d77b-4d17-bcad-ea49b45adbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'volume_size': 1} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] creating volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] create volume {'name': 'v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'is_clone': False, 'name': 'v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6c3630e-67ca-4a09-9975-66944ed8d16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82736664-020d-4939-b0fc-3c2b9e48a20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Volume volume-0c953a4d-d77b-4d17-bcad-ea49b45adbb9 (0c953a4d-d77b-4d17-bcad-ea49b45adbb9): created successfully Apr 14 00:18:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82736664-020d-4939-b0fc-3c2b9e48a20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Flow 'volume_create_manager' (9b6f3aaf-5424-4492-9ec6-a1ae8dce7123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:25 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a704635f-7fad-42c2-a355-f2e08ff9d884 tempest-ServerRescueNegativeTestJSON-1055458768 None] Created volume successfully. Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Acquiring lock "cinder-a7501233-eeb6-4ef4-8e07-4f0b28e2f902-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Lock "cinder-a7501233-eeb6-4ef4-8e07-4f0b28e2f902-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] remove_export for volume: a7501233-eeb6-4ef4-8e07-4f0b28e2f902. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1137683442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a7501233-eeb6-4ef4-8e07-4f0b28e2f902,launched_at=2023-04-14T00:17:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth='CHAP PtALrNGE D9SvxyrRlQ3Ykt',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:18:33Z,updated_at=2023-04-14T00:18:33Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] detach volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 from target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902/luns/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] failed to remove resource iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 because of JDSS resource v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] delete target: iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] delete target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] failed to remove resource iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 because of JDSS resource iqn.2010-10.org.openstack:a7501233-eeb6-4ef4-8e07-4f0b28e2f902 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] deleating volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] get snapshots for volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] get volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432855', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108384', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '616614610492485093', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ac77f44de00b08be', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321108992', 'san:volume_id': 'ac77f44de00b08bea90f8fb26f637ff9cbf1e842', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79531', 'name': 'v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] delete volume:v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:18:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] volume v_a7501233-eeb6-4ef4-8e07-4f0b28e2f902 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=15,cinder:UPDATE=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.quota [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Created reservations ['580d2641-dbe0-4f45-919f-cdbaea2a94fe', 'b2bd4cea-5ddf-417e-8fac-4eba98275a30', '5798e984-d658-4527-a766-bd102ef9a74d', '0e9e0f1e-456e-4d48-8656-9d5abb8f50f0'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321203200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.manager [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:18:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Deleted volume successfully. Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0d8632ad-6947-4507-8e99-4613262a96b3 tempest-AttachVolumeTestJSON-1885059489 None] Lock "cinder-a7501233-eeb6-4ef4-8e07-4f0b28e2f902-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Acquiring lock "cinder-89a24f9a-783f-4d14-8413-4fb61263665e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Lock "cinder-89a24f9a-783f-4d14-8413-4fb61263665e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] remove_export for volume: 89a24f9a-783f-4d14-8413-4fb61263665e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-726511793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=89a24f9a-783f-4d14-8413-4fb61263665e,launched_at=2023-04-14T00:17:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth='CHAP qzxBPYXt HXI7xbhJ1Gd2Nq',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:18:37Z,updated_at=2023-04-14T00:18:37Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] detach volume v_89a24f9a-783f-4d14-8413-4fb61263665e from target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e/luns/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] failed to remove resource iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e because of JDSS resource v_89a24f9a-783f-4d14-8413-4fb61263665e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] delete target: iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] delete target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] failed to remove resource iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e because of JDSS resource iqn.2010-10.org.openstack:89a24f9a-783f-4d14-8413-4fb61263665e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] deleating volume v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] get snapshots for volume v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] get volume v_89a24f9a-783f-4d14-8413-4fb61263665e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_89a24f9a-783f-4d14-8413-4fb61263665e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432845', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108370', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14894672923246264397', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fd57dc8d96e8e901', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321203200', 'san:volume_id': 'fd57dc8d96e8e9018c9683c9242ad757e7c8a5aa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '77683', 'name': 'v_89a24f9a-783f-4d14-8413-4fb61263665e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] delete volume:v_89a24f9a-783f-4d14-8413-4fb61263665e recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_89a24f9a-783f-4d14-8413-4fb61263665e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] volume v_89a24f9a-783f-4d14-8413-4fb61263665e deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.quota [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Created reservations ['91d9fa34-2e83-42aa-97aa-858af72751a3', 'eddb2f0c-83b9-4c07-af35-2e435020d156', '1eacdd06-37d7-450b-ad85-38d92990fde3', 'd1f7400b-123b-48c2-9d71-1a24001396f6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321285120', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.manager [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:18:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Deleted volume successfully. Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5edd4a90-4045-44b0-8774-340e71971933 tempest-AttachVolumeTestJSON-1885059489 None] Lock "cinder-89a24f9a-783f-4d14-8413-4fb61263665e-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Acquiring lock "cinder-5021c122-fea0-4125-8b1f-c1ab3c4de5e7-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:18:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Lock "cinder-5021c122-fea0-4125-8b1f-c1ab3c4de5e7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] remove_export for volume: 5021c122-fea0-4125-8b1f-c1ab3c4de5e7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-155776098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5021c122-fea0-4125-8b1f-c1ab3c4de5e7,launched_at=2023-04-14T00:06:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec1aab0338ff4bd195a37a4199a378eb',provider_auth='CHAP npILkxwF Vg2EonFjihLZT1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:18:40Z,updated_at=2023-04-14T00:18:40Z,use_quota=True,user_id='44530987616b417d87ce5909d8de1871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] detach volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 from target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7/luns/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] failed to remove resource iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 because of JDSS resource v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] delete target: iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] delete target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] failed to remove resource iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 because of JDSS resource iqn.2010-10.org.openstack:5021c122-fea0-4125-8b1f-c1ab3c4de5e7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] deleating volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] get snapshots for volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] get volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432222', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107853', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2990139661759842409', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '8f1e01a4693a5b73', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321285120', 'san:volume_id': '8f1e01a4693a5b73fb0f140ea11a01ee696b91fa', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79082', 'name': 'v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] delete volume:v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] volume v_5021c122-fea0-4125-8b1f-c1ab3c4de5e7 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.quota [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Created reservations ['fb954394-9e3d-4431-adfd-954925f8c473', '0664cc58-edf0-43f1-89c6-b0b2c9d5be4a', '9259aae5-d215-4aa2-b63a-1ab14e497cd0', '6af382fe-6be5-4e77-ae8f-839e1ed484eb'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] terminate connection for 94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:18:42 user cinder-volume[84560]: INFO cinder.volume.manager [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Deleting attachment 54e4b1f5-010b-4766-ab8a-d6eea6f1f43b. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1167118353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94d1d134-5857-4a7c-bf52-bd818e828f3e,launched_at=2023-04-14T00:13:48Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP YrRJCHcL Iao2OgXFZDwCrm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:47Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:16:07Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] detach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e from target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321367040', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:18:43 user cinder-volume[84560]: DEBUG cinder.manager [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:18:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Deleted volume successfully. Apr 14 00:18:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-75b1872e-9bc3-4193-a202-d213e857ccf1 tempest-AttachVolumeTestJSON-1885059489 None] Lock "cinder-5021c122-fea0-4125-8b1f-c1ab3c4de5e7-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:18:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-76bd4151-57a8-4b55-bdd7-443d0f4855a5 req-6b2641e3-9be8-4d09-be4f-045b755343d0 tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] copy_volume_to_image volume-6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) copy_volume_to_image /opt/stack/cinder/cinder/volume/driver.py:930}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG os_brick.utils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] ==> get_connector_properties: call "{'root_helper': 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': False, 'host': None, 'execute': None}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae533b3-129c-4f1a-b053-7f172b2339fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6fec92fcfdd3\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b8c0c-2833-424d-91d4-944e0f4984d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed1cfab-04a6-47ac-b3fd-20d69c14b7ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[62197f31-5aca-45e9-93e4-cd80f3d4876c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Running cmd (subprocess): nvme version {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] 'nvme version' failed. Not Retrying. {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.nvmeof [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] nvme not present on system {{(pid=84560) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}} Apr 14 00:18:44 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}} Apr 14 00:18:45 user cinder-volume[84560]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme' Apr 14 00:18:45 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b634134-0931-4cf0-9377-3f63c08e169c]: (4, '') {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=84560) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] LIGHTOS: did not find dsc, continuing anyway. {{(pid=84560) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.lightos [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] LIGHTOS: no hostnqn found. {{(pid=84560) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG os_brick.utils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6fec92fcfdd3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9: creating export {{(pid=84560) _attach_volume /opt/stack/cinder/cinder/volume/driver.py:1051}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] create export for volume: 6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] ensure volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] check if targe iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] create target and attach volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] create target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] atach volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 to target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=52,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] terminate connection for 69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:18:48 user cinder-volume[84560]: INFO cinder.volume.manager [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Terminate volume connection completed successfully. Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Deleting attachment 1cf6ab58-ea49-4409-8a5b-bbc6e23cbce0. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] remove_export for volume: 69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1491387094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=69599ada-93d4-425a-ae12-e52cafcc29f7,launched_at=2023-04-14T00:16:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='e6be95e5c8d94269802ecf487ff73104',provider_auth='CHAP FZCpIqMc YBMVW8jwfFc6td',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:48Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:16:59Z,use_quota=True,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] detach volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 from target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Flow 'volume_create_manager' (066153a9-2bcb-4b02-958e-4988f7e46888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be0f26e-bd92-4e1a-a472-9eddfae3122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be0f26e-bd92-4e1a-a472-9eddfae3122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1335541518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0106414f6564501a7ccddb434d0d2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:18:49Z,use_quota=True,user_id='944cc95b96d64a70a88b5d22ceeaf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468a5e85-0882-4e7b-bbcb-07a0f335e4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (468a5e85-0882-4e7b-bbcb-07a0f335e4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8930169-ceb7-433e-a978-d269afab2a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8930169-ceb7-433e-a978-d269afab2a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'volume_name': 'volume-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4ac174-7411-494e-9c17-b7e038d21285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4ac174-7411-494e-9c17-b7e038d21285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875e51f3-acb6-4fe4-a991-d848dc74427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:49 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Volume 5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'volume_size': 1} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] creating volume v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] create volume {'name': 'v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] delete target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] delete target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-082496c2-5103-4cdc-bd75-e33ecb9c797c req-c4dc32da-c172-44fc-b122-520c5873d246 tempest-TestShelveInstance-5222591 None] target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3261343466333233', 'lun': 0, 'mode': 'wt', 'name': 'v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'prod_id': 'Storage', 'scsi_id': '2a44f32304f4ddcd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] add credentails to target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Geting {'code': 201, 'error': None, 'data': {'name': 'suTbmgUi'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] initialize_connection for 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connector [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Factory for iscsi on None {{(pid=84560) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suTbmgUi', 'auth_password': '***', 'target_lun': False}}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:18:49 user cinder-volume[84560]: INFO os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Trying to connect to iSCSI portal 172.16.0.220:3260 Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2038e-eb69-450f-ae07-39bfbe3b9394]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm (): stdout= stderr=iscsiadm: No records found Apr 14 00:18:49 user cinder-volume[84560]: {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --interface default --op new {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63da145-97d2-41e3-b04a-3bcc7a363e3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9] added\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9] added Apr 14 00:18:49 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa8bc80-ecd3-4e6e-bda6-a09ea0d473fa]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad05ff8c-5ed2-4eae-99b5-92f82b5baf81]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:49 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suTbmgUi {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suTbmgUi" returned: 0 in 0.024s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5086a4b8-8fa1-48ea-858e-d660b9f0374f]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'suTbmgUi'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10bba06-51c8-4475-9346-22d6ad942447]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ff0fd7-e641-489c-a0a3-21b4cbd436bd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --login {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f487f3-dac3-4bd5-b625-6384f3dd39af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260] Apr 14 00:18:50 user cinder-volume[84560]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260] successful. Apr 14 00:18:50 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6de565-924f-4d07-b103-13ea69ec8817]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'is_clone': False, 'name': 'v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875e51f3-acb6-4fe4-a991-d848dc74427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972ccf7f-c3fa-4600-9632-7948cedc4f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d6cff-8bd3-45d3-bf7f-2d913477c305]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash) Apr 14 00:18:50 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Connected to 172.16.0.220:3260 {{(pid=84560) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=84560) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Scanning host 33 c: -, t: -, l: 0) {{(pid=84560) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Volume volume-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 (5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981): created successfully Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972ccf7f-c3fa-4600-9632-7948cedc4f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Flow 'volume_create_manager' (066153a9-2bcb-4b02-958e-4988f7e46888) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3a7a0b-d642-4676-9121-af0111e2607c]: (4, ('- - 0', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=84560) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suTbmgUi', 'auth_password': '***', 'target_lun': False} {{(pid=84560) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}} Apr 14 00:18:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f163ccf8-d20c-4637-90be-f0eaf12ac4d6 tempest-VolumesTestJSON-1300607219 None] Created volume successfully. Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Acquiring lock "cinder-9693166b-92aa-49ac-8a18-6a7a4ad4e119-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Lock "cinder-9693166b-92aa-49ac-8a18-6a7a4ad4e119-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] remove_export for volume: 9693166b-92aa-49ac-8a18-6a7a4ad4e119. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1133955403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9693166b-92aa-49ac-8a18-6a7a4ad4e119,launched_at=2023-04-14T00:14:15Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20caf676a64b9b97027f3fc9bc724c',provider_auth='CHAP ktTlqcpv nPDqLG2JacbmN9',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:14:14Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:18:51Z,updated_at=2023-04-14T00:18:51Z,use_quota=True,user_id='2f8b18d40ecd4b4e976cf2018af8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] detach volume v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 from target iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119/luns/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119/luns/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119/luns/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119/luns/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] failed to remove resource iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 because of JDSS resource v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] delete target: iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] delete target iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] failed to remove resource iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 because of JDSS resource iqn.2010-10.org.openstack:9693166b-92aa-49ac-8a18-6a7a4ad4e119 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] deleating volume v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] get snapshots for volume v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] get volume v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432664', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108233', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10960384309055452753', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '47f7d4fa2611fd3d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321293312', 'san:volume_id': '47f7d4fa2611fd3db3c3999fdecaf936ff47c6c2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78706', 'name': 'v_9693166b-92aa-49ac-8a18-6a7a4ad4e119', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] delete volume:v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23261343466333233', 'path': '/dev/sdb'} {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): dd if=/dev/sdb of=/dev/null count=1 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "dd if=/dev/sdb of=/dev/null count=1" returned: 0 in 0.015s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab9d96a-3872-4014-a67f-632dfcc8ac9e]: (4, ('', '1+0 records in\n1+0 records out\n512 bytes copied, 0.00276497 s, 185 kB/s\n')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.image.image_utils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] 2dd480ce-d110-43c9-88d2-1c2b72b2c254 was raw, no need to convert to raw {{(pid=84560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1004}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdb {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:18:51 user sudo[104779]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdb Apr 14 00:18:51 user sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Flow 'volume_create_manager' (2421e828-0d58-4221-b136-85145231ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b44f4a-f52f-4435-9802-e35979b319cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b44f4a-f52f-4435-9802-e35979b319cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1851280488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8dc456e2-5ce9-441f-8852-e0acc6c327ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0106414f6564501a7ccddb434d0d2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:18:51Z,use_quota=True,user_id='944cc95b96d64a70a88b5d22ceeaf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c43248-1056-43f0-86b4-22f1568eb223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c43248-1056-43f0-86b4-22f1568eb223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ab8f0-1346-4843-ab7a-ec45cb4c4cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678ab8f0-1346-4843-ab7a-ec45cb4c4cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'volume_name': 'volume-8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f841d2f-3b81-4ca7-b5fc-629a0323ff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f841d2f-3b81-4ca7-b5fc-629a0323ff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c45b0fa-86a8-41f6-8f09-81bf93941f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Volume 8dc456e2-5ce9-441f-8852-e0acc6c327ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'volume_size': 1} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] creating volume v_8dc456e2-5ce9-441f-8852-e0acc6c327ec. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] create volume {'name': 'v_8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:52 user sudo[104779]: pam_unix(sudo:session): session closed for user root Apr 14 00:18:52 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 1001 /dev/sdb" returned: 0 in 1.063s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'is_clone': False, 'name': 'v_8dc456e2-5ce9-441f-8852-e0acc6c327ec'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c45b0fa-86a8-41f6-8f09-81bf93941f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd48e565-8c88-4ba6-89e2-509d969c99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Volume volume-8dc456e2-5ce9-441f-8852-e0acc6c327ec (8dc456e2-5ce9-441f-8852-e0acc6c327ec): created successfully Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd48e565-8c88-4ba6-89e2-509d969c99a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Flow 'volume_create_manager' (2421e828-0d58-4221-b136-85145231ee81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-60c740d2-07f9-44b0-ab0c-3b92d7a6dfb3 tempest-VolumesTestJSON-1300607219 None] Created volume successfully. Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] volume v_9693166b-92aa-49ac-8a18-6a7a4ad4e119 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.quota [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Created reservations ['46487810-64e8-416a-97d1-55dafc3db02a', '77253edf-ae40-4e4f-a190-6e2896961d47', 'bbb46a77-9b31-465a-bbea-2fa6fc93a962', '807cb933-98f6-4b37-8c45-4adb886ad8bd'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=57,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321281024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.manager [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:18:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Deleted volume successfully. Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2f74e3ea-4170-4fca-bc9f-4634fba45536 tempest-AttachVolumeShelveTestJSON-1395403129 None] Lock "cinder-9693166b-92aa-49ac-8a18-6a7a4ad4e119-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Acquiring lock "cinder-af1b05d2-717a-489c-8bdf-160d00ebd122-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Lock "cinder-af1b05d2-717a-489c-8bdf-160d00ebd122-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:18:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Flow 'volume_create_manager' (dc7a7c5b-12a6-4ded-b70b-ddf204e68186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056ea069-8b9e-401f-87ba-f97b483fa670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056ea069-8b9e-401f-87ba-f97b483fa670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-134602764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f39da6ca-c616-4b91-8966-df4107a5c582,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0106414f6564501a7ccddb434d0d2c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:18:54Z,use_quota=True,user_id='944cc95b96d64a70a88b5d22ceeaf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95637f-4a42-426c-bd7d-869e36bdcf30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95637f-4a42-426c-bd7d-869e36bdcf30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbed8d8-042c-4b6c-a697-bd7fb164796a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfbed8d8-042c-4b6c-a697-bd7fb164796a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f39da6ca-c616-4b91-8966-df4107a5c582', 'volume_name': 'volume-f39da6ca-c616-4b91-8966-df4107a5c582', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f4e6ab-368a-4ed1-91ee-2d1541081492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52f4e6ab-368a-4ed1-91ee-2d1541081492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149df4cc-548c-4662-b0d3-9c9bc953d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:54 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Volume f39da6ca-c616-4b91-8966-df4107a5c582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f39da6ca-c616-4b91-8966-df4107a5c582', 'volume_size': 1} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] creating volume v_f39da6ca-c616-4b91-8966-df4107a5c582. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] create volume {'name': 'v_f39da6ca-c616-4b91-8966-df4107a5c582', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] remove_export for volume: af1b05d2-717a-489c-8bdf-160d00ebd122. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1863658117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=af1b05d2-717a-489c-8bdf-160d00ebd122,launched_at=2023-04-14T00:06:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f20caf676a64b9b97027f3fc9bc724c',provider_auth='CHAP dekLAOnU ga78o1DC2Jwvyk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:06:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:18:54Z,updated_at=2023-04-14T00:18:54Z,use_quota=True,user_id='2f8b18d40ecd4b4e976cf2018af8220c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] detach volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 from target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122/luns/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] failed to remove resource iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 because of JDSS resource v_af1b05d2-717a-489c-8bdf-160d00ebd122 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] delete target: iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] delete target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] failed to remove resource iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 because of JDSS resource iqn.2010-10.org.openstack:af1b05d2-717a-489c-8bdf-160d00ebd122 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] deleating volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] get snapshots for volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] get volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_af1b05d2-717a-489c-8bdf-160d00ebd122', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432222', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '107856', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17880420028678517428', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4c58f43f2bc5fa7b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321199104', 'san:volume_id': '4c58f43f2bc5fa7b8ce3960fea19f4f0d4fc7538', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79090', 'name': 'v_af1b05d2-717a-489c-8bdf-160d00ebd122', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] delete volume:v_af1b05d2-717a-489c-8bdf-160d00ebd122 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f39da6ca-c616-4b91-8966-df4107a5c582', 'is_clone': False, 'name': 'v_f39da6ca-c616-4b91-8966-df4107a5c582'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149df4cc-548c-4662-b0d3-9c9bc953d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f39da6ca-c616-4b91-8966-df4107a5c582', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73710930-8d27-4487-a333-edea6cd96e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:18:55 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Volume volume-f39da6ca-c616-4b91-8966-df4107a5c582 (f39da6ca-c616-4b91-8966-df4107a5c582): created successfully Apr 14 00:18:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73710930-8d27-4487-a333-edea6cd96e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:18:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Flow 'volume_create_manager' (dc7a7c5b-12a6-4ded-b70b-ddf204e68186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:18:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4b695d2a-f02a-4313-b582-27c08c0bd71e tempest-VolumesTestJSON-1300607219 None] Created volume successfully. Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_af1b05d2-717a-489c-8bdf-160d00ebd122 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] volume v_af1b05d2-717a-489c-8bdf-160d00ebd122 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.quota [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Created reservations ['d0415466-e2cc-4ed5-b533-0d682f49f2bb', '12fd46dc-7a06-424a-8a12-4929fa218300', '09d2355c-cb83-4406-9d4b-cfce1615071d', 'ecd49a67-d26c-4f68-9041-2251879f67f5'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Acquiring lock "cinder-f39da6ca-c616-4b91-8966-df4107a5c582-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Lock "cinder-f39da6ca-c616-4b91-8966-df4107a5c582-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] remove_export for volume: f39da6ca-c616-4b91-8966-df4107a5c582. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-134602764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f39da6ca-c616-4b91-8966-df4107a5c582,launched_at=2023-04-14T00:18:55Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0106414f6564501a7ccddb434d0d2c3',provider_auth='CHAP YBaHZMpN Q36PBOhYzwng8f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:54Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:18:57Z,updated_at=2023-04-14T00:18:57Z,use_quota=True,user_id='944cc95b96d64a70a88b5d22ceeaf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] detach volume v_f39da6ca-c616-4b91-8966-df4107a5c582 from target iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582/luns/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582/luns/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582/luns/v_f39da6ca-c616-4b91-8966-df4107a5c582'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582/luns/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] failed to remove resource iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 because of JDSS resource v_f39da6ca-c616-4b91-8966-df4107a5c582 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] delete target: iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] delete target iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] failed to remove resource iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 because of JDSS resource iqn.2010-10.org.openstack:f39da6ca-c616-4b91-8966-df4107a5c582 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] deleating volume v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] get snapshots for volume v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321281024', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.manager [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:18:57 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Deleted volume successfully. Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b85d260d-48d9-4c38-8856-eb4c04957750 tempest-AttachVolumeShelveTestJSON-1395403129 None] Lock "cinder-af1b05d2-717a-489c-8bdf-160d00ebd122-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] get volume v_f39da6ca-c616-4b91-8966-df4107a5c582 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f39da6ca-c616-4b91-8966-df4107a5c582', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432944', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108431', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12294471698871194035', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '13e078a81c1d2597', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321281024', 'san:volume_id': '13e078a81c1d2597b216546e6f64c005cc034870', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78844', 'name': 'v_f39da6ca-c616-4b91-8966-df4107a5c582', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] delete volume:v_f39da6ca-c616-4b91-8966-df4107a5c582 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:18:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:18:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f39da6ca-c616-4b91-8966-df4107a5c582 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:18:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] volume v_f39da6ca-c616-4b91-8966-df4107a5c582 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Created reservations ['cd6c9c53-309d-46a4-badd-0d43360db998', '145d7b10-2b39-4188-86c3-d23d745f0a8f', '7be79438-7325-4a19-a7bf-11ccc70b2365', '67b28460-9702-4a2a-8b0c-b464de3908c2'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Acquiring lock "cinder-8dc456e2-5ce9-441f-8852-e0acc6c327ec-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Lock "cinder-8dc456e2-5ce9-441f-8852-e0acc6c327ec-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=54,cinder:UPDATE=39,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] remove_export for volume: 8dc456e2-5ce9-441f-8852-e0acc6c327ec. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1851280488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8dc456e2-5ce9-441f-8852-e0acc6c327ec,launched_at=2023-04-14T00:18:53Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0106414f6564501a7ccddb434d0d2c3',provider_auth='CHAP WkdZVOHo FDHl9JSOpzNMe8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:00Z,updated_at=2023-04-14T00:19:00Z,use_quota=True,user_id='944cc95b96d64a70a88b5d22ceeaf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] detach volume v_8dc456e2-5ce9-441f-8852-e0acc6c327ec from target iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec/luns/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec/luns/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec/luns/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec/luns/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] failed to remove resource iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec because of JDSS resource v_8dc456e2-5ce9-441f-8852-e0acc6c327ec DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] delete target: iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] delete target iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] failed to remove resource iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec because of JDSS resource iqn.2010-10.org.openstack:8dc456e2-5ce9-441f-8852-e0acc6c327ec DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] deleating volume v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] get snapshots for volume v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321362944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.manager [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:00 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Deleted volume successfully. Apr 14 00:19:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6a2d4549-d814-4ebe-abd3-afdbc91e7d62 tempest-VolumesTestJSON-1300607219 None] Lock "cinder-f39da6ca-c616-4b91-8966-df4107a5c582-delete_volume" released by "delete_volume" :: held 3.777s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] get volume v_8dc456e2-5ce9-441f-8852-e0acc6c327ec info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432941', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108426', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13608592131352330534', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '03d0e018ab2df064', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321362944', 'san:volume_id': '03d0e018ab2df064ec6389046d89954d0b099565', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79907', 'name': 'v_8dc456e2-5ce9-441f-8852-e0acc6c327ec', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] delete volume:v_8dc456e2-5ce9-441f-8852-e0acc6c327ec recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc456e2-5ce9-441f-8852-e0acc6c327ec {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] volume v_8dc456e2-5ce9-441f-8852-e0acc6c327ec deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.quota [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Created reservations ['79aa4c71-9816-4a50-a208-501080ad0d38', '1af0f80e-cb5b-46d9-94a8-9fc081d0f0fc', '8cafbdb3-d66e-4192-a1b8-b0dccd866ec7', 'ce9d2a2a-2330-472e-b377-b9b6da3ac930'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321444864', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.manager [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:04 user cinder-volume[84560]: INFO cinder.volume.manager [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Deleted volume successfully. Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.coordination [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Acquiring lock "cinder-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.coordination [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Lock "cinder-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.coordination [None req-700699c9-257d-4e1c-b157-c1fdf17984cb tempest-VolumesTestJSON-1300607219 None] Lock "cinder-8dc456e2-5ce9-441f-8852-e0acc6c327ec-delete_volume" released by "delete_volume" :: held 3.985s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] remove_export for volume: 5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1335541518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981,launched_at=2023-04-14T00:18:50Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d0106414f6564501a7ccddb434d0d2c3',provider_auth='CHAP EYJZpqRk 0s2iPLedRHYkFg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:04Z,updated_at=2023-04-14T00:19:04Z,use_quota=True,user_id='944cc95b96d64a70a88b5d22ceeaf22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] detach volume v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 from target iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/luns/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/luns/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/luns/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/luns/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] failed to remove resource iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 because of JDSS resource v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] delete target: iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] delete target iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] failed to remove resource iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 because of JDSS resource iqn.2010-10.org.openstack:5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] deleating volume v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] get snapshots for volume v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] get volume v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432939', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108422', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9287311124552903537', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a7279dac0b6c7336', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321444864', 'san:volume_id': 'a7279dac0b6c7336428d5984e338f2d8ecfb0492', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79897', 'name': 'v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] delete volume:v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:05 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0257d4d3-ef02-4a1b-b749-410f783bcd8e tempest-GroupsTest-1410350200 None] Group tempest-Group1-385677039: creating Apr 14 00:19:05 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0257d4d3-ef02-4a1b-b749-410f783bcd8e tempest-GroupsTest-1410350200 None] Group tempest-Group1-385677039: created successfully Apr 14 00:19:05 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0257d4d3-ef02-4a1b-b749-410f783bcd8e tempest-GroupsTest-1410350200 None] Create group completed successfully. Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] volume v_5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.quota [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Created reservations ['c24169d0-5fd4-4ab7-961d-de1531971532', '485bc157-3130-4921-98fe-521d614accf9', 'd5ee5d2d-6c6b-4e8c-8d25-f42ddf8ee4fb', '48ec568c-319b-48b9-acdb-59aa9fa58f2f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:DELETE=3,cinder:SELECT=56,cinder:UPDATE=33,cinder:INSERT=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a75dace4-b0a1-48b3-b4eb-ccfd1ef469c2 tempest-GroupsTest-1410350200 None] Group tempest-Group2-2035029889: creating Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a75dace4-b0a1-48b3-b4eb-ccfd1ef469c2 tempest-GroupsTest-1410350200 None] Group tempest-Group2-2035029889: created successfully Apr 14 00:19:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a75dace4-b0a1-48b3-b4eb-ccfd1ef469c2 tempest-GroupsTest-1410350200 None] Create group completed successfully. Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321539072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.manager [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Deleted volume successfully. Apr 14 00:19:07 user cinder-volume[84560]: DEBUG cinder.coordination [None req-152f6f46-e8fc-4742-a530-85e905b3a693 tempest-VolumesTestJSON-1300607219 None] Lock "cinder-5a43fee2-fdb1-48b4-8fb2-9d14bd5e0981-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Flow 'volume_create_manager' (d6e57d66-64a5-4c5d-bd0b-885a127aa48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c962f0d-0294-4b4d-9ea0-bc993d07db9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c962f0d-0294-4b4d-9ea0-bc993d07db9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-663588574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21d238ba-15cb-4f78-95c0-68d5da655edf,host='user@joviandss-2#joviandss-2',id=42b5151d-a9d6-4670-8a39-900d7316bd10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecac309976b442d99a498245b42f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:09Z,use_quota=True,user_id='576b44b5eab84e2d9c72e421715d9d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b727648-7d7e-4d73-b29d-2a08c8237963),volume_type_id=9b727648-7d7e-4d73-b29d-2a08c8237963)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df1a020-66c7-4724-b86d-2f711c4ccd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df1a020-66c7-4724-b86d-2f711c4ccd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6ad7e3-bed3-4e15-9d3f-fab9df7580ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6ad7e3-bed3-4e15-9d3f-fab9df7580ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b5151d-a9d6-4670-8a39-900d7316bd10', 'volume_name': 'volume-42b5151d-a9d6-4670-8a39-900d7316bd10', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318009e4-c32c-4314-a221-cff026c05b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318009e4-c32c-4314-a221-cff026c05b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe1077c-6f70-46f3-9d14-effb565fba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:08 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Volume 42b5151d-a9d6-4670-8a39-900d7316bd10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b5151d-a9d6-4670-8a39-900d7316bd10', 'volume_size': 1} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] creating volume v_42b5151d-a9d6-4670-8a39-900d7316bd10. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] create volume {'name': 'v_42b5151d-a9d6-4670-8a39-900d7316bd10', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_42b5151d-a9d6-4670-8a39-900d7316bd10', 'is_clone': False, 'name': 'v_42b5151d-a9d6-4670-8a39-900d7316bd10'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe1077c-6f70-46f3-9d14-effb565fba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b5151d-a9d6-4670-8a39-900d7316bd10', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2e5945-0ad5-4a76-93c7-e50b1422e2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:09 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Volume volume-42b5151d-a9d6-4670-8a39-900d7316bd10 (42b5151d-a9d6-4670-8a39-900d7316bd10): created successfully Apr 14 00:19:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2e5945-0ad5-4a76-93c7-e50b1422e2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Flow 'volume_create_manager' (d6e57d66-64a5-4c5d-bd0b-885a127aa48a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:10 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9c96d789-a8e9-411a-bf77-6a17b83eb910 tempest-GroupsTest-1410350200 None] Created volume successfully. Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:11 user sudo[104921]: stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb Apr 14 00:19:11 user sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001) Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] remove_export for volume: 42b5151d-a9d6-4670-8a39-900d7316bd10. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-663588574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=21d238ba-15cb-4f78-95c0-68d5da655edf,host='user@joviandss-2#joviandss-2',id=42b5151d-a9d6-4670-8a39-900d7316bd10,launched_at=2023-04-14T00:19:10Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecac309976b442d99a498245b42f2e7',provider_auth='CHAP syqPOhil AYqKBJUoL7hg1j',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:09Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:19:11Z,use_quota=True,user_id='576b44b5eab84e2d9c72e421715d9d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b727648-7d7e-4d73-b29d-2a08c8237963),volume_type_id=9b727648-7d7e-4d73-b29d-2a08c8237963) from target:iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] detach volume v_42b5151d-a9d6-4670-8a39-900d7316bd10 from target iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10/luns/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10/luns/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10/luns/v_42b5151d-a9d6-4670-8a39-900d7316bd10'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10/luns/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] failed to remove resource iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 because of JDSS resource v_42b5151d-a9d6-4670-8a39-900d7316bd10 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] delete target: iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] delete target iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] failed to remove resource iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 because of JDSS resource iqn.2010-10.org.openstack:42b5151d-a9d6-4670-8a39-900d7316bd10 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] deleating volume v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] get snapshots for volume v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:11 user sudo[104921]: pam_unix(sudo:session): session closed for user root Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chown 0 /dev/sdb" returned: 0 in 0.693s {{(pid=84560) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] ==> disconnect_volume: call "{'args': (, {'target_iqn': 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suTbmgUi', 'auth_password': '***', 'target_lun': 0, 'encrypted': False}, {'type': 'block', 'scsi_wwn': '23261343466333233', 'path': '/dev/sdb'}), 'kwargs': {'force': True}}" {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[072b2870-baaa-4511-9b1f-896d92c8eabb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS: Apr 14 00:19:11 user cinder-volume[84560]: No targets found. Apr 14 00:19:11 user cinder-volume[84560]: iSNS: Apr 14 00:19:11 user cinder-volume[84560]: No targets found. Apr 14 00:19:11 user cinder-volume[84560]: STATIC: Apr 14 00:19:11 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc Apr 14 00:19:11 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:19:11 user cinder-volume[84560]: Iface Name: default Apr 14 00:19:11 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 Apr 14 00:19:11 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:19:11 user cinder-volume[84560]: Iface Name: default Apr 14 00:19:11 user cinder-volume[84560]: Target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 Apr 14 00:19:11 user cinder-volume[84560]: Portal: 172.16.0.220:3260,-1 Apr 14 00:19:11 user cinder-volume[84560]: Iface Name: default Apr 14 00:19:11 user cinder-volume[84560]: FIRMWARE: Apr 14 00:19:11 user cinder-volume[84560]: No targets found. Apr 14 00:19:11 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Regex to get portals from discoverydb: ^SENDTARGETS: Apr 14 00:19:11 user cinder-volume[84560]: .*?^DiscoveryAddress: 172.16.0.220,3260.*? Apr 14 00:19:11 user cinder-volume[84560]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=84560) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 0)] {{(pid=84560) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7063d7d4-f87f-4d3d-800f-a626b0a1292f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:11 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1899bd-08a2-4ce6-b78e-c6b16d4f193e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash)\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash) Apr 14 00:19:12 user cinder-volume[84560]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash) Apr 14 00:19:12 user cinder-volume[84560]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash) Apr 14 00:19:12 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc (non-flash) Apr 14 00:19:12 user cinder-volume[84560]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 (non-flash) Apr 14 00:19:12 user cinder-volume[84560]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 (non-flash) Apr 14 00:19:12 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Resulting device map defaultdict(. at 0x7fdcc87bfac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9'): ({'sdb'}, set())}) {{(pid=84560) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Removing single pathed devices sdb {{(pid=84560) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e8ad58-e928-4dcf-8583-87521f0363c0]: (4, ('path checker states:\nup 3\n\npaths: 0\nbusy: False\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] get volume v_42b5151d-a9d6-4670-8a39-900d7316bd10 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cbca78-8c5f-4525-8654-5004576ed872]: (4, ('ok\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Flushing IO for device /dev/sdb {{(pid=84560) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_42b5151d-a9d6-4670-8a39-900d7316bd10', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432959', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108439', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10501629104560445848', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b81feaeb33d8bdad', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321457152', 'san:volume_id': 'b81feaeb33d8bdad2a794ab30a7745d0c24c6832', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79920', 'name': 'v_42b5151d-a9d6-4670-8a39-900d7316bd10', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] delete volume:v_42b5151d-a9d6-4670-8a39-900d7316bd10 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c2810f-dea0-4c47-8240-4f41756b38ac]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=84560) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f21ca7-b13c-42f4-bb3d-e602a8d68e3e]: (4, ('1', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Checking to see if SCSI volumes sdb have been removed. {{(pid=84560) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.linuxscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] SCSI volumes sdb have been removed. {{(pid=84560) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9')] {{(pid=84560) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77830d-633f-4e16-bd0c-75a173492d7b]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --logout {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[696068ed-f1c6-4733-9b89-921d966f3bd0]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260] Apr 14 00:19:12 user cinder-volume[84560]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9, portal: 172.16.0.220,3260] successful. Apr 14 00:19:12 user cinder-volume[84560]: stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op delete {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=91493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7eb6a4-54c9-4b95-9f23-60349aaaefc7]: (4, ('', '')) {{(pid=91493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=84560) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.base [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=84560) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG os_brick.initiator.connectors.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] <== disconnect_volume: return (291ms) None {{(pid=84560) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] terminate connection for 6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.driver [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] volume 6cafbda8-d881-4ce4-b77f-a22e606d9ac9: removing export {{(pid=84560) _detach_volume /opt/stack/cinder/cinder/volume/driver.py:560}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] remove_export for volume: 6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711029289',ec2_id=None,encryption_key_id=None,glance_metadata={},group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cafbda8-d881-4ce4-b77f-a22e606d9ac9,launched_at=2023-04-14T00:13:17Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='67e9bf71f0644907979ec775c62a0b39',provider_auth='CHAP suTbmgUi f9v0LCHDY34Qes',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='uploading',terminated_at=None,updated_at=2023-04-14T00:18:44Z,use_quota=True,user_id='719f2342cc1d452daae3a4ded790f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] detach volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 from target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] delete target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] delete target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:19:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Uploaded volume to glance image-id: 2dd480ce-d110-43c9-88d2-1c2b72b2c254. {{(pid=84560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1793}} Apr 14 00:19:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-233044b3-16bf-43a7-b41f-2e5ea2481286 tempest-VolumesActionsTest-422643142 None] Copy volume to image completed successfully. Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_42b5151d-a9d6-4670-8a39-900d7316bd10 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] volume v_42b5151d-a9d6-4670-8a39-900d7316bd10 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.quota [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Created reservations ['2ad83867-5c71-489f-876f-49b9b72aead0'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:13 user cinder-volume[84560]: WARNING cinder.quota [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-68069491 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-68069491, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:19:13 user cinder-volume[84560]: WARNING cinder.quota [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-68069491 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-68069491, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.quota [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Created reservations ['3e209f72-5973-48eb-abf3-147c78073ebf', '6d6e320a-95ab-461c-94a4-e6a5ec12e70c', '90e2c242-b853-467c-85f3-3645cb9952a7', '982efaa1-994b-4cc8-bbec-3826b6906929'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321539072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.manager [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7dfefbb9-9605-4b75-9def-324364dbecc5 tempest-GroupsTest-1410350200 None] Delete group completed successfully. Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Acquiring lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] remove_export for volume: 6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] detach volume:Volume(_name_id=None,admin_metadata={readonly='False'},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1711029289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cafbda8-d881-4ce4-b77f-a22e606d9ac9,launched_at=2023-04-14T00:13:17Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='67e9bf71f0644907979ec775c62a0b39',provider_auth='CHAP suTbmgUi f9v0LCHDY34Qes',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:15Z,updated_at=2023-04-14T00:19:15Z,use_quota=True,user_id='719f2342cc1d452daae3a4ded790f69a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] detach volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 from target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9/luns/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] failed to remove resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 because of JDSS resource v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] delete target: iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] delete target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=66,cinder:DELETE=2,cinder:INSERT=7,cinder:UPDATE=25 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] failed to remove resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 because of JDSS resource iqn.2010-10.org.openstack:6cafbda8-d881-4ce4-b77f-a22e606d9ac9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] deleating volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] get snapshots for volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.quota [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Created reservations ['59eb182f-0321-45dc-ba8d-64d63fa89f04'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] get volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432606', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108183', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16470073651411627943', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2a44f32304f4ddcd', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321539072', 'san:volume_id': '2a44f32304f4ddcde15f51593de9801833781aea', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78454', 'name': 'v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] delete volume:v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321539072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:15 user cinder-volume[84560]: DEBUG cinder.manager [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:15 user cinder-volume[84560]: INFO cinder.volume.manager [None req-817362b3-11da-4ebb-98c2-08f8eae17bff tempest-GroupsTest-1410350200 None] Delete group completed successfully. Apr 14 00:19:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-303f1441-fe58-4839-b005-85d23ff69da2 tempest-GroupsTest-1410350200 None] Group tempest-GroupsTest-Group-910263261: creating Apr 14 00:19:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-303f1441-fe58-4839-b005-85d23ff69da2 tempest-GroupsTest-1410350200 None] Group tempest-GroupsTest-Group-910263261: created successfully Apr 14 00:19:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-303f1441-fe58-4839-b005-85d23ff69da2 tempest-GroupsTest-1410350200 None] Create group completed successfully. Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] volume v_6cafbda8-d881-4ce4-b77f-a22e606d9ac9 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.quota [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Created reservations ['74ac3815-095c-4811-9a07-4f106e7d01e6', 'd48e2e07-db18-4788-a053-f8de677c947f', 'e2b12bf1-7b73-42ce-91b1-aee729f3767a', 'eb50e730-2e8f-4127-ae7c-50a2275bc89e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=65,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321633280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.manager [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:18 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Deleted volume successfully. Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1d81e951-b9f7-4a57-9780-64f3c71e1db1 tempest-VolumesActionsTest-422643142 None] Lock "cinder-6cafbda8-d881-4ce4-b77f-a22e606d9ac9-delete_volume" released by "delete_volume" :: held 3.264s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Flow 'volume_create_manager' (d374de30-fbb3-4424-a718-f4e5b0497b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0b3f81-ca3d-447b-9320-2ece307c3c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0b3f81-ca3d-447b-9320-2ece307c3c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1650332580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da0d431-4a63-4f41-be9e-755ec5632c4b,host='user@joviandss-2#joviandss-2',id=12af5dfb-f602-47e6-aaeb-067f01994cde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecac309976b442d99a498245b42f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:18Z,use_quota=True,user_id='576b44b5eab84e2d9c72e421715d9d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4a86f5-05c6-4a59-874e-a83b080386fa),volume_type_id=0e4a86f5-05c6-4a59-874e-a83b080386fa)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c63391-5286-4ff6-a15f-09720045de7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c63391-5286-4ff6-a15f-09720045de7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1632259-9bca-4d87-832a-7b0decc1afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1632259-9bca-4d87-832a-7b0decc1afc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12af5dfb-f602-47e6-aaeb-067f01994cde', 'volume_name': 'volume-12af5dfb-f602-47e6-aaeb-067f01994cde', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80efc752-d281-41d1-a703-67ecde54768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80efc752-d281-41d1-a703-67ecde54768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24b1f9e-a7d7-424e-b1ae-efcf41fc24ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:18 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Volume 12af5dfb-f602-47e6-aaeb-067f01994cde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12af5dfb-f602-47e6-aaeb-067f01994cde', 'volume_size': 1} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] creating volume v_12af5dfb-f602-47e6-aaeb-067f01994cde. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] create volume {'name': 'v_12af5dfb-f602-47e6-aaeb-067f01994cde', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_12af5dfb-f602-47e6-aaeb-067f01994cde', 'is_clone': False, 'name': 'v_12af5dfb-f602-47e6-aaeb-067f01994cde'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24b1f9e-a7d7-424e-b1ae-efcf41fc24ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12af5dfb-f602-47e6-aaeb-067f01994cde', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f4702d-7286-4263-b49e-d40263b0ff86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:19 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Volume volume-12af5dfb-f602-47e6-aaeb-067f01994cde (12af5dfb-f602-47e6-aaeb-067f01994cde): created successfully Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f4702d-7286-4263-b49e-d40263b0ff86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Flow 'volume_create_manager' (d374de30-fbb3-4424-a718-f4e5b0497b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e23394ae-52a9-4503-8ff5-404e7c67ca58 tempest-GroupsTest-1410350200 None] Created volume successfully. Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Flow 'volume_create_manager' (2994bc01-46e5-4acb-b8fb-13a76ff6b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d63b92-2b5e-41d8-a0b7-8feca21d3e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d63b92-2b5e-41d8-a0b7-8feca21d3e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752792632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da0d431-4a63-4f41-be9e-755ec5632c4b,host='user@joviandss-2#joviandss-2',id=d4bac669-c49b-4ce7-a704-112a15e483d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecac309976b442d99a498245b42f2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:20Z,use_quota=True,user_id='576b44b5eab84e2d9c72e421715d9d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4a86f5-05c6-4a59-874e-a83b080386fa),volume_type_id=0e4a86f5-05c6-4a59-874e-a83b080386fa)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38bc87a-294a-47eb-9cba-e3e6063bdf6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a38bc87a-294a-47eb-9cba-e3e6063bdf6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7189f7e0-c247-45fc-aedf-8341d4950995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7189f7e0-c247-45fc-aedf-8341d4950995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4bac669-c49b-4ce7-a704-112a15e483d0', 'volume_name': 'volume-d4bac669-c49b-4ce7-a704-112a15e483d0', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1882c1-d21f-491a-b1e5-fbd96c4b5e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1882c1-d21f-491a-b1e5-fbd96c4b5e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ccb914-6407-410c-a49b-77e7d82a06f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:19 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Volume d4bac669-c49b-4ce7-a704-112a15e483d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4bac669-c49b-4ce7-a704-112a15e483d0', 'volume_size': 1} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] creating volume v_d4bac669-c49b-4ce7-a704-112a15e483d0. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] create volume {'name': 'v_d4bac669-c49b-4ce7-a704-112a15e483d0', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Flow 'volume_create_manager' (7987c6f1-4418-40f9-ba35-b2dafb2c285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d273e-6728-4fa2-94bb-95f80824f92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d4bac669-c49b-4ce7-a704-112a15e483d0', 'is_clone': False, 'name': 'v_d4bac669-c49b-4ce7-a704-112a15e483d0'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e80d273e-6728-4fa2-94bb-95f80824f92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-938450506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bd129a5f-f710-4034-adb6-28bb63c1ebd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29101fabc9c14f049664e1fc586ab57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:21Z,use_quota=True,user_id='42303a7891894ae389c3602648b5cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46be7055-9a10-48ad-8795-6d8c3b6efee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46be7055-9a10-48ad-8795-6d8c3b6efee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650cb275-7c57-43f9-af23-fb5d98ba3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650cb275-7c57-43f9-af23-fb5d98ba3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'volume_name': 'volume-bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5b0f70-f7d9-482b-b0ce-71ac2a790e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe5b0f70-f7d9-482b-b0ce-71ac2a790e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfcb2ac-74c3-4541-8076-b97f23660087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:20 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Volume bd129a5f-f710-4034-adb6-28bb63c1ebd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'volume_size': 1} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] creating volume v_bd129a5f-f710-4034-adb6-28bb63c1ebd2. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] create volume {'name': 'v_bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ccb914-6407-410c-a49b-77e7d82a06f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4bac669-c49b-4ce7-a704-112a15e483d0', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:20 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd42b7b6-d08c-4058-b028-37431c253a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Volume volume-d4bac669-c49b-4ce7-a704-112a15e483d0 (d4bac669-c49b-4ce7-a704-112a15e483d0): created successfully Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd42b7b6-d08c-4058-b028-37431c253a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Flow 'volume_create_manager' (2994bc01-46e5-4acb-b8fb-13a76ff6b26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-23fc281b-372a-45a7-bf40-e9b3fc496b8b tempest-GroupsTest-1410350200 None] Created volume successfully. Apr 14 00:19:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Flow 'volume_create_manager' (58d33555-5863-4354-9752-684b3fdcb948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119442da-9664-41e3-9b9f-fa277ff8ee18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119442da-9664-41e3-9b9f-fa277ff8ee18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1860686779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=00e5cc12-5280-4d3c-a5f7-1c68553ce0c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda6679a105249439aa3a4354582671a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:22Z,use_quota=True,user_id='11b9259dfebc427bbc610439e564d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64b9d8c-f59d-46ff-a1f0-62b2aa620e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64b9d8c-f59d-46ff-a1f0-62b2aa620e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa15be95-7298-4f99-9397-cca16b8a9a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa15be95-7298-4f99-9397-cca16b8a9a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'volume_name': 'volume-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3037a9-e4f2-4169-a3a8-5847d78be1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3037a9-e4f2-4169-a3a8-5847d78be1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae6698a-8d49-4c58-bd48-21b0fbb112f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Volume 00e5cc12-5280-4d3c-a5f7-1c68553ce0c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'volume_size': 1} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] creating volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] create volume {'name': 'v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'is_clone': False, 'name': 'v_bd129a5f-f710-4034-adb6-28bb63c1ebd2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dfcb2ac-74c3-4541-8076-b97f23660087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d76f2c-84bd-4f83-9672-31c7b5af8d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:21 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Volume volume-bd129a5f-f710-4034-adb6-28bb63c1ebd2 (bd129a5f-f710-4034-adb6-28bb63c1ebd2): created successfully Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d76f2c-84bd-4f83-9672-31c7b5af8d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:21 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Flow 'volume_create_manager' (7987c6f1-4418-40f9-ba35-b2dafb2c285a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2f8cadcb-b2d7-4449-9619-f68b317ecd02 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Created volume successfully. Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321387520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Acquiring lock "cinder-bd129a5f-f710-4034-adb6-28bb63c1ebd2-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Lock "cinder-bd129a5f-f710-4034-adb6-28bb63c1ebd2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] remove_export for volume: bd129a5f-f710-4034-adb6-28bb63c1ebd2. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-938450506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bd129a5f-f710-4034-adb6-28bb63c1ebd2,launched_at=2023-04-14T00:19:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29101fabc9c14f049664e1fc586ab57e',provider_auth='CHAP tKhfeDXO Rlc1soVGjXDQuH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:21Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:22Z,updated_at=2023-04-14T00:19:22Z,use_quota=True,user_id='42303a7891894ae389c3602648b5cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] detach volume v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 from target iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2/luns/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2/luns/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:22 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f954d63e-f27b-4fa1-a5d5-add82f6bc298 tempest-GroupsTest-1410350200 None] Update group completed successfully. Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2/luns/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2/luns/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] failed to remove resource iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 because of JDSS resource v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] delete target: iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] delete target iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] failed to remove resource iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 because of JDSS resource iqn.2010-10.org.openstack:bd129a5f-f710-4034-adb6-28bb63c1ebd2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] deleating volume v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] get snapshots for volume v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'is_clone': False, 'name': 'v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae6698a-8d49-4c58-bd48-21b0fbb112f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11242f39-bec6-4038-b6c6-1cfad7ed565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:22 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Volume volume-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 (00e5cc12-5280-4d3c-a5f7-1c68553ce0c4): created successfully Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11242f39-bec6-4038-b6c6-1cfad7ed565c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Flow 'volume_create_manager' (58d33555-5863-4354-9752-684b3fdcb948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:22 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f0d864de-c137-4b0a-b2d0-3a7e643ff7f4 tempest-VolumesSnapshotListTestJSON-454545848 None] Created volume successfully. Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] get volume v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432971', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108453', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8408891016026653208', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '896439614c21c5eb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321268736', 'san:volume_id': '896439614c21c5eba7734f17e4cf9c9e2289c35f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79158', 'name': 'v_bd129a5f-f710-4034-adb6-28bb63c1ebd2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] delete volume:v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] create snapshot 8c1d3da5-8d85-4b98-8dd1-c3a691939141 for volume 00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] cloning v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 to s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] create snapshot s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:23 user cinder-volume[84560]: INFO cinder.volume.manager [None req-551965fe-6992-4afa-8800-265b9334e2d4 tempest-GroupsTest-1410350200 None] Update group completed successfully. Apr 14 00:19:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_8c1d3da5-8d85-4b98-8dd1-c3a691939141'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] create volume s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 from snapshot s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:19:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] volume v_bd129a5f-f710-4034-adb6-28bb63c1ebd2 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4@s_8c1d3da5-8d85-4b98-8dd1-c3a691939141', 'is_clone': True, 'full_name': 'Pool-0/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141', 'name': 's_8c1d3da5-8d85-4b98-8dd1-c3a691939141'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.quota [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Created reservations ['385ac2b4-7d3a-4d04-9c56-d69c2ba2f37c', 'd05b755e-ce40-4ab9-9dda-c8374afb0934', 'e7914044-01ee-4315-811b-8b927f685891', '691b5960-d985-4323-85a2-73d8d1162ddd'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] volume s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:24 user cinder-volume[84560]: INFO cinder.volume.manager [None req-75900173-ad41-4473-b0fa-8dd280c2e924 tempest-VolumesSnapshotListTestJSON-454545848 None] Create snapshot completed successfully Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] create snapshot 55dd5fbd-1e42-4db1-ad4e-678a356faf05 for volume 00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] cloning v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 to s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] create snapshot s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=60,cinder:UPDATE=32,cinder:INSERT=4,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] remove_export for volume: 12af5dfb-f602-47e6-aaeb-067f01994cde. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1650332580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da0d431-4a63-4f41-be9e-755ec5632c4b,host='user@joviandss-2#joviandss-2',id=12af5dfb-f602-47e6-aaeb-067f01994cde,launched_at=2023-04-14T00:19:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecac309976b442d99a498245b42f2e7',provider_auth='CHAP bQeonaVi W4no8G2hDIqOz0',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:18Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:19:25Z,use_quota=True,user_id='576b44b5eab84e2d9c72e421715d9d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4a86f5-05c6-4a59-874e-a83b080386fa),volume_type_id=0e4a86f5-05c6-4a59-874e-a83b080386fa) from target:iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] detach volume v_12af5dfb-f602-47e6-aaeb-067f01994cde from target iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde/luns/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde/luns/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde/luns/v_12af5dfb-f602-47e6-aaeb-067f01994cde'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde/luns/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] failed to remove resource iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde because of JDSS resource v_12af5dfb-f602-47e6-aaeb-067f01994cde DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] delete target: iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] delete target iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321338368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.manager [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:25 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Deleted volume successfully. Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] failed to remove resource iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde because of JDSS resource iqn.2010-10.org.openstack:12af5dfb-f602-47e6-aaeb-067f01994cde DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] deleating volume v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] get snapshots for volume v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-e1c26486-896b-4279-97cf-e7f604673c2d tempest-VolumeQuotasAdminTestJSON-1167486752 None] Lock "cinder-bd129a5f-f710-4034-adb6-28bb63c1ebd2-delete_volume" released by "delete_volume" :: held 3.282s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Flow 'volume_create_manager' (48adfd71-eec5-486b-8a43-d02c5ea51cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f21b5d5-a4ab-4d7b-bb64-f42e461e2854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f21b5d5-a4ab-4d7b-bb64-f42e461e2854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1957938664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29101fabc9c14f049664e1fc586ab57e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:26Z,use_quota=True,user_id='42303a7891894ae389c3602648b5cacc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69dfe00-3f6e-4fb8-88d2-97f4de5d3229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69dfe00-3f6e-4fb8-88d2-97f4de5d3229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5d49c-9143-4825-883f-51569056a22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eb5d49c-9143-4825-883f-51569056a22f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'volume_name': 'volume-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039d6a09-5517-4145-824b-9fc8f287c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (039d6a09-5517-4145-824b-9fc8f287c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6c4344-d987-4dd0-b72e-0a8f6d8fc260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Volume 6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'volume_size': 1} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] creating volume v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] create volume {'name': 'v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] get volume v_12af5dfb-f602-47e6-aaeb-067f01994cde info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_12af5dfb-f602-47e6-aaeb-067f01994cde', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432968', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108445', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '164961284942632338', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd7dd6ebf5c150272', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321326080', 'san:volume_id': 'd7dd6ebf5c150272b9bd89330eb2510894fc2403', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79737', 'name': 'v_12af5dfb-f602-47e6-aaeb-067f01994cde', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] delete volume:v_12af5dfb-f602-47e6-aaeb-067f01994cde recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_55dd5fbd-1e42-4db1-ad4e-678a356faf05'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] create volume s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 from snapshot s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'is_clone': False, 'name': 'v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc6c4344-d987-4dd0-b72e-0a8f6d8fc260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae64994-77f4-419e-b341-906d613dfa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Volume volume-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f (6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f): created successfully Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae64994-77f4-419e-b341-906d613dfa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Flow 'volume_create_manager' (48adfd71-eec5-486b-8a43-d02c5ea51cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-cfe004fb-0d53-4692-ae59-ba24afe52549 tempest-VolumeQuotasAdminTestJSON-1167486752 None] Created volume successfully. Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4@s_55dd5fbd-1e42-4db1-ad4e-678a356faf05', 'is_clone': True, 'full_name': 'Pool-0/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05', 'name': 's_55dd5fbd-1e42-4db1-ad4e-678a356faf05'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] volume s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:19:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d308e264-b0c3-40ca-b2ca-6b058c01796e tempest-VolumesSnapshotListTestJSON-454545848 None] Create snapshot completed successfully Apr 14 00:19:27 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8e3f8c9a-9aba-4199-8c41-c9a33d458269 tempest-VolumeQuotasAdminTestJSON-2075870293 None] Transfer volume completed successfully. Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] create snapshot cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 for volume 00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] cloning v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 to s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] create snapshot s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Acquiring lock "cinder-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Lock "cinder-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] remove_export for volume: 6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1957938664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f,launched_at=2023-04-14T00:19:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b62b1a1b294aa6a1072765e13bc484',provider_auth='CHAP gmFwhlQR MakpIoPD2biAzm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:28Z,updated_at=2023-04-14T00:19:28Z,use_quota=True,user_id='8f515482e6ac439d9273f98cf4416ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] detach volume v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f from target iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/luns/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/luns/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/luns/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/luns/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] failed to remove resource iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f because of JDSS resource v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] delete target: iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] delete target iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] failed to remove resource iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f because of JDSS resource iqn.2010-10.org.openstack:6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] deleating volume v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] get snapshots for volume v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12af5dfb-f602-47e6-aaeb-067f01994cde {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] volume v_12af5dfb-f602-47e6-aaeb-067f01994cde deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] remove_export for volume: d4bac669-c49b-4ce7-a704-112a15e483d0. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-752792632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7da0d431-4a63-4f41-be9e-755ec5632c4b,host='user@joviandss-2#joviandss-2',id=d4bac669-c49b-4ce7-a704-112a15e483d0,launched_at=2023-04-14T00:19:21Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ecac309976b442d99a498245b42f2e7',provider_auth='CHAP PHdQJqnw g3UiEOWfN05chp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:20Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=None,updated_at=2023-04-14T00:19:25Z,use_quota=True,user_id='576b44b5eab84e2d9c72e421715d9d24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0e4a86f5-05c6-4a59-874e-a83b080386fa),volume_type_id=0e4a86f5-05c6-4a59-874e-a83b080386fa) from target:iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] detach volume v_d4bac669-c49b-4ce7-a704-112a15e483d0 from target iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0/luns/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0/luns/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0/luns/v_d4bac669-c49b-4ce7-a704-112a15e483d0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0/luns/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] failed to remove resource iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 because of JDSS resource v_d4bac669-c49b-4ce7-a704-112a15e483d0 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] delete target: iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] delete target iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] failed to remove resource iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 because of JDSS resource iqn.2010-10.org.openstack:d4bac669-c49b-4ce7-a704-112a15e483d0 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] deleating volume v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] get snapshots for volume v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] get volume v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432975', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108470', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8275354180479969092', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '079bdf357d9d1f02', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321289216', 'san:volume_id': '079bdf357d9d1f02ffb51c487461fe70a2a862ea', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80007', 'name': 'v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] delete volume:v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] get volume v_d4bac669-c49b-4ce7-a704-112a15e483d0 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d4bac669-c49b-4ce7-a704-112a15e483d0', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432970', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108449', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5517685008127055402', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c68aa20c69c27f0d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321289216', 'san:volume_id': 'c68aa20c69c27f0ddd6655575b4107463ef3430c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79149', 'name': 'v_d4bac669-c49b-4ce7-a704-112a15e483d0', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] delete volume:v_d4bac669-c49b-4ce7-a704-112a15e483d0 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] create volume s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 from snapshot s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4@s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328', 'is_clone': True, 'full_name': 'Pool-0/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328', 'name': 's_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] volume s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:19:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2a635359-a40e-4a5a-a1f2-c5c1c4f7bdfe tempest-VolumesSnapshotListTestJSON-454545848 None] Create snapshot completed successfully Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d4bac669-c49b-4ce7-a704-112a15e483d0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] volume v_d4bac669-c49b-4ce7-a704-112a15e483d0 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=68,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] volume v_6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Created reservations ['e1c2ae12-4639-4ea8-9f2e-ef4e16dad8b1'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:30 user cinder-volume[84560]: WARNING cinder.quota [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1153626434 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1153626434, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:19:30 user cinder-volume[84560]: WARNING cinder.quota [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1153626434 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1153626434, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Created reservations ['2747345c-08aa-4274-a2e3-72868c56fb9e', 'd4c7c8fc-bf0f-48af-85c4-d545d0b3a5dd', 'cff0341c-8682-4284-abd8-3ff80e2c5e69', 'bb576343-5206-473d-b6e4-ec961aa37aae'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Created reservations ['ce8348dd-7777-4be7-97fc-0f82768f08f9', '2d648148-da0f-4221-b791-3f4b6f441fb4', 'b6712931-a8bd-4ffe-8b8a-c2707d2a38d9', '12853bee-c373-4ea5-8af9-29abbc0fdd3f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Created reservations ['6fdef414-6fe6-4f4a-b54f-a87f5dd29a45', '4d17e64b-d42d-463f-963b-62e27ab75f00', '0e076440-9d60-4354-80f1-4fb0f5085062', '04d29bcc-0bbc-43c4-9b51-4d24fd7efa8a'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Acquiring lock "cinder-cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] deleating snapshot s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] get snapshots for volume s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321338368', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.manager [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e9b49d2f-3f1a-471f-948c-6cac3a0263d6 tempest-GroupsTest-1410350200 None] Delete group completed successfully. Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] get volume s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4@s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432978', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108481', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17455256299560110754', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4cb53ebbc7c77efe', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321403904', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '77694', 'name': 's_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] delete snapshot s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 of volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321403904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:30 user cinder-volume[84560]: DEBUG cinder.manager [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Deleted volume successfully. Apr 14 00:19:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6b5fec8f-cead-4461-87c3-6b57534f2e8c tempest-VolumeQuotasAdminTestJSON-1277038231 None] Lock "cinder-6c9c238f-d0ff-4cd9-ac3c-b16a48579f6f-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] snapshot s_cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:19:32 user cinder-volume[84560]: DEBUG cinder.quota [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Created reservations ['3aa5be29-4809-4a8a-bcf0-e6576ddb77ff', 'c7bfe2c5-8fa6-4d6f-9437-2e67f860e3f7', '409389c0-72de-4c14-b770-8ed220faa3ba', '1639591d-f875-4152-b55e-9d53e5c2d33e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:32 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Delete snapshot completed successfully. Apr 14 00:19:32 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b252f44b-e270-4120-a908-c61e772b618b tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-cfbd1bc7-b0a8-47ac-8d37-5fcd1da50328-delete_snapshot" released by "delete_snapshot" :: held 2.423s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Acquiring lock "cinder-55dd5fbd-1e42-4db1-ad4e-678a356faf05-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-55dd5fbd-1e42-4db1-ad4e-678a356faf05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] deleating snapshot s_55dd5fbd-1e42-4db1-ad4e-678a356faf05. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:19:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] get snapshots for volume s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] get volume s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4@s_55dd5fbd-1e42-4db1-ad4e-678a356faf05', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432975', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108473', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14172528230446028935', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '20d6208cad3e7b9e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321416192', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80015', 'name': 's_55dd5fbd-1e42-4db1-ad4e-678a356faf05', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] delete snapshot s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 of volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Flow 'volume_create_manager' (0e28c1bc-cc24-4de1-9937-7f8e7ebf4e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c75786-ce6f-4370-83dc-1933496f6f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=53,cinder:DELETE=4,cinder:UPDATE=36,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c75786-ce6f-4370-83dc-1933496f6f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1793016784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bca83f34-5989-4188-abaa-205a9770d290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:35Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051f99bb-5fa7-4a1b-a4d6-418fd66f2fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (051f99bb-5fa7-4a1b-a4d6-418fd66f2fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd92cbcb-47d2-4b99-9a0f-c246e354b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd92cbcb-47d2-4b99-9a0f-c246e354b85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca83f34-5989-4188-abaa-205a9770d290', 'volume_name': 'volume-bca83f34-5989-4188-abaa-205a9770d290', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b38c35b-9554-4842-8786-40ed47897353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b38c35b-9554-4842-8786-40ed47897353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d697e1e-9bcd-489b-a362-702d6ff78285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:35 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Volume bca83f34-5989-4188-abaa-205a9770d290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca83f34-5989-4188-abaa-205a9770d290', 'volume_size': 1} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] creating volume v_bca83f34-5989-4188-abaa-205a9770d290. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] create volume {'name': 'v_bca83f34-5989-4188-abaa-205a9770d290', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] snapshot s_55dd5fbd-1e42-4db1-ad4e-678a356faf05 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.quota [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Created reservations ['573a7f39-a32c-4ec4-b6c4-d3631c3f0050', '0d5e5dfc-60da-4df1-abb6-8e7244e31821', '6ac6d1a9-dd01-4a7b-b2d9-db040bf30d18', '63f128e3-6c70-4f98-bbb8-e0ccc18e6db3'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=33 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Delete snapshot completed successfully. Apr 14 00:19:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-68bbcd9a-9178-4cb2-9655-e10708ce36dc tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-55dd5fbd-1e42-4db1-ad4e-678a356faf05-delete_snapshot" released by "delete_snapshot" :: held 2.291s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_bca83f34-5989-4188-abaa-205a9770d290', 'is_clone': False, 'name': 'v_bca83f34-5989-4188-abaa-205a9770d290'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d697e1e-9bcd-489b-a362-702d6ff78285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca83f34-5989-4188-abaa-205a9770d290', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b185ce60-dd5d-4ef2-aba4-51d24c28a115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:36 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Volume volume-bca83f34-5989-4188-abaa-205a9770d290 (bca83f34-5989-4188-abaa-205a9770d290): created successfully Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b185ce60-dd5d-4ef2-aba4-51d24c28a115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Flow 'volume_create_manager' (0e28c1bc-cc24-4de1-9937-7f8e7ebf4e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-aa4fcef1-520d-4994-a34b-0838ccaa1a5f tempest-AttachVolumeNegativeTest-719597397 None] Created volume successfully. Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Acquiring lock "cinder-8c1d3da5-8d85-4b98-8dd1-c3a691939141-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-8c1d3da5-8d85-4b98-8dd1-c3a691939141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] deleating snapshot s_8c1d3da5-8d85-4b98-8dd1-c3a691939141. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] get snapshots for volume s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Flow 'volume_create_manager' (8ccc8485-97dc-4b39-aa8d-919226acba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc42a9ce-d7e2-4ae7-9d4b-4461acfece0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc42a9ce-d7e2-4ae7-9d4b-4461acfece0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-846524746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fe52606f-fa24-4339-b4ac-87e5b40fc3d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b781fa4f834e5485e82f897d4d3365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:37Z,use_quota=True,user_id='ae14ed0d0706410194e7828cad232294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ca246b-8ec7-4cdd-95a2-e2e6ad123900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ca246b-8ec7-4cdd-95a2-e2e6ad123900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a91976-18ea-4b23-a859-94d7a6447337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9a91976-18ea-4b23-a859-94d7a6447337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'volume_name': 'volume-fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a0398-5ff6-4658-b6ee-807c65349b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488a0398-5ff6-4658-b6ee-807c65349b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf49bdc-f82a-43b3-9750-ad6aeec005db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Volume fe52606f-fa24-4339-b4ac-87e5b40fc3d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'volume_size': 1} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] creating volume v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] create volume {'name': 'v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] get volume s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4@s_8c1d3da5-8d85-4b98-8dd1-c3a691939141', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432973', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108464', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5129648663081861227', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '64d50a9bcda3833f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321354752', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79946', 'name': 's_8c1d3da5-8d85-4b98-8dd1-c3a691939141', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] delete snapshot s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 of volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Flow 'volume_create_manager' (61968502-e529-4b48-8f4a-efdb3a748f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb3e0ad-d008-4e93-a025-cc060b7c73fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb3e0ad-d008-4e93-a025-cc060b7c73fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1496077152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=189b21a7-78a7-4dd4-9b62-f4ab7a19c1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b179ba2b4045158e34ddad4022f9b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:38Z,use_quota=True,user_id='c1550c3f833a4fa4a6d93917c768fa4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184639d2-e698-4e96-b0fe-a592b1ae32b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (184639d2-e698-4e96-b0fe-a592b1ae32b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c05b15-4764-484e-adcc-75ed2842ecf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c05b15-4764-484e-adcc-75ed2842ecf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'volume_name': 'volume-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8af943-8654-44e0-863c-baef2a9e2793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8af943-8654-44e0-863c-baef2a9e2793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bf4564-0db2-4a40-babf-8c58672a2678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Volume 189b21a7-78a7-4dd4-9b62-f4ab7a19c1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'volume_size': 1} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] creating volume v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] create volume {'name': 'v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'is_clone': False, 'name': 'v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf49bdc-f82a-43b3-9750-ad6aeec005db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121b00b1-a4e2-487c-9f15-cf4f92674b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Volume volume-fe52606f-fa24-4339-b4ac-87e5b40fc3d8 (fe52606f-fa24-4339-b4ac-87e5b40fc3d8): created successfully Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (121b00b1-a4e2-487c-9f15-cf4f92674b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Flow 'volume_create_manager' (8ccc8485-97dc-4b39-aa8d-919226acba0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-456cc411-e939-464e-9208-ad0b3978ea02 tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Created volume successfully. Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] create export for volume: bca83f34-5989-4188-abaa-205a9770d290. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] ensure volume bca83f34-5989-4188-abaa-205a9770d290 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] check if targe iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] create target and attach volume bca83f34-5989-4188-abaa-205a9770d290 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] create target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'is_clone': False, 'name': 'v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33bf4564-0db2-4a40-babf-8c58672a2678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ceed50f-b98e-42e1-a69f-00d548d64239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:38 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Volume volume-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da (189b21a7-78a7-4dd4-9b62-f4ab7a19c1da): created successfully Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ceed50f-b98e-42e1-a69f-00d548d64239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:38 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Flow 'volume_create_manager' (61968502-e529-4b48-8f4a-efdb3a748f7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d7ab6436-e741-4fe4-840c-ad726edd7bca tempest-AbsoluteLimitsTests-2092721694 None] Created volume successfully. Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots/s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] snapshot s_8c1d3da5-8d85-4b98-8dd1-c3a691939141 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.quota [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Created reservations ['6c4182ac-27bf-47a5-a5a8-68a21ddb3714', '8e80b738-c46e-40c5-93e0-f391f1fd036b', 'e272c9a4-7a87-414e-afb9-6f81404dda99', 'cd8cceef-1812-43cf-b783-74f0f40fa9f9'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Acquiring lock "cinder-fe52606f-fa24-4339-b4ac-87e5b40fc3d8-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Lock "cinder-fe52606f-fa24-4339-b4ac-87e5b40fc3d8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Delete snapshot completed successfully. Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-208608c7-532b-4741-b03c-2537f8324548 tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-8c1d3da5-8d85-4b98-8dd1-c3a691939141-delete_snapshot" released by "delete_snapshot" :: held 2.282s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] remove_export for volume: fe52606f-fa24-4339-b4ac-87e5b40fc3d8. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-846524746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=fe52606f-fa24-4339-b4ac-87e5b40fc3d8,launched_at=2023-04-14T00:19:38Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='b0b781fa4f834e5485e82f897d4d3365',provider_auth='CHAP pNyLaUiz zp6UkxoRGcIAve',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:37Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:39Z,updated_at=2023-04-14T00:19:39Z,use_quota=True,user_id='ae14ed0d0706410194e7828cad232294',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] detach volume v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 from target iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8/luns/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8/luns/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8/luns/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8/luns/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] failed to remove resource iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 because of JDSS resource v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] delete target: iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] delete target iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] failed to remove resource iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 because of JDSS resource iqn.2010-10.org.openstack:fe52606f-fa24-4339-b4ac-87e5b40fc3d8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] deleating volume v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] get snapshots for volume v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] get volume v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432987', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108500', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7369988942418578359', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e5aa9ec4a17353f7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321203200', 'san:volume_id': 'e5aa9ec4a17353f7425f848b0046633bd0450431', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78201', 'name': 'v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] delete volume:v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Acquiring lock "cinder-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] remove_export for volume: 00e5cc12-5280-4d3c-a5f7-1c68553ce0c4. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1860686779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=00e5cc12-5280-4d3c-a5f7-1c68553ce0c4,launched_at=2023-04-14T00:19:22Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eda6679a105249439aa3a4354582671a',provider_auth='CHAP ACGIZSuV X6ZjeGrLnAv9oM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:22Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:40Z,updated_at=2023-04-14T00:19:40Z,use_quota=True,user_id='11b9259dfebc427bbc610439e564d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] detach volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 from target iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/luns/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/luns/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/luns/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/luns/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] failed to remove resource iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 because of JDSS resource v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] delete target: iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] delete target iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] failed to remove resource iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 because of JDSS resource iqn.2010-10.org.openstack:00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] deleating volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] get snapshots for volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Acquiring lock "cinder-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Lock "cinder-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] remove_export for volume: 189b21a7-78a7-4dd4-9b62-f4ab7a19c1da. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1496077152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=189b21a7-78a7-4dd4-9b62-f4ab7a19c1da,launched_at=2023-04-14T00:19:39Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06b179ba2b4045158e34ddad4022f9b7',provider_auth='CHAP IJLGjmEn 1t6arRDZlk0P2p',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:38Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:40Z,updated_at=2023-04-14T00:19:40Z,use_quota=True,user_id='c1550c3f833a4fa4a6d93917c768fa4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] detach volume v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da from target iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/luns/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/luns/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] get volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432971', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108457', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5937058106783209359', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '29b6ad2021b05e68', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321203200', 'san:volume_id': '29b6ad2021b05e6888052419ebb9028e819ccf67', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79931', 'name': 'v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] delete volume:v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] atach volume v_bca83f34-5989-4188-abaa-205a9770d290 to target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] volume v_fe52606f-fa24-4339-b4ac-87e5b40fc3d8 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/luns/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/luns/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] failed to remove resource iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da because of JDSS resource v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] delete target: iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] delete target iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] failed to remove resource iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da because of JDSS resource iqn.2010-10.org.openstack:189b21a7-78a7-4dd4-9b62-f4ab7a19c1da DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] deleating volume v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] get snapshots for volume v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.quota [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Created reservations ['17a44e71-3906-47a9-b7d0-9f08e2182b55', '88bd5b6d-887d-4062-a650-11d34afa7f4a', 'caf7627a-1d3e-499b-a84c-02d943760ffe', 'a7150b13-0130-4935-be8c-fc63553d3e1f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] get volume v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6531326663356339', 'lun': 0, 'mode': 'wt', 'name': 'v_bca83f34-5989-4188-abaa-205a9770d290', 'prod_id': 'Storage', 'scsi_id': 'e12fc5c9d966b3de'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] add credentails to target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321379328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.manager [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Deleted volume successfully. Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432988', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108507', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9953401459452766661', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5026dee0cebb58d9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321379328', 'san:volume_id': '5026dee0cebb58d95003c56e702b6c153c13139e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80266', 'name': 'v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] delete volume:v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe8608f7-fef7-47f6-a1fb-fb24fc3177be tempest-VolumeQuotasNegativeTestJSON-2130738069 None] Lock "cinder-fe52606f-fa24-4339-b4ac-87e5b40fc3d8-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 201, 'error': None, 'data': {'name': 'zWIOlNdw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] volume v_00e5cc12-5280-4d3c-a5f7-1c68553ce0c4 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] initialize_connection for bca83f34-5989-4188-abaa-205a9770d290 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.quota [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Created reservations ['f1190ee2-9f63-4fa4-b887-033e3dc441f5', 'f5c1d6a6-144b-4e91-8798-e8d7adf786ed', '43cc9c23-f57f-4756-9c16-3849907f486a', '4e2d48f0-3285-4b29-b17e-3d19378ec6ea'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=54,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zWIOlNdw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e467c4d8-36db-43d6-b51d-b2870d751a8e'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=65,cinder:DELETE=1,cinder:UPDATE=30,cinder:INSERT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:43 user cinder-volume[84560]: INFO cinder.volume.manager [req-abbbea7d-78dc-4482-b785-a1f5a4b1ff53 req-763ee49c-d44d-4997-a636-f683180b578e tempest-AttachVolumeNegativeTest-719597397 None] attachment_update completed successfully. Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321379328', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.manager [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Deleted volume successfully. Apr 14 00:19:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-48d8e234-7245-45d7-b857-0e49341c7724 tempest-VolumesSnapshotListTestJSON-454545848 None] Lock "cinder-00e5cc12-5280-4d3c-a5f7-1c68553ce0c4-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] volume v_189b21a7-78a7-4dd4-9b62-f4ab7a19c1da deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.quota [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Created reservations ['1ec236ce-8b0a-42f8-b5ab-be8b055f885e', '4759cf38-f0d5-417e-9d6b-d0ba2995f9f9', 'e7cadc3a-3223-412f-ae6d-1d88eaf86a15', 'e5b317cb-627a-4903-a63d-31111f600217'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321461248', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.manager [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:45 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Deleted volume successfully. Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6dee9286-1bbb-48b7-8b4e-01662290032e tempest-AbsoluteLimitsTests-2092721694 None] Lock "cinder-189b21a7-78a7-4dd4-9b62-f4ab7a19c1da-delete_volume" released by "delete_volume" :: held 5.348s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (9e2c2420-a225-4405-861e-923491da9225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c578a14a-89bf-465e-96bb-d2a2381a52a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c578a14a-89bf-465e-96bb-d2a2381a52a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-598410572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6836482e-3e12-4a80-902c-4ee08ab65f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:46Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4138d9ab-e74d-4575-972a-0c801eae34c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4138d9ab-e74d-4575-972a-0c801eae34c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f388e-1eee-49fc-ac55-fa995f04be7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e0f388e-1eee-49fc-ac55-fa995f04be7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6836482e-3e12-4a80-902c-4ee08ab65f0b', 'volume_name': 'volume-6836482e-3e12-4a80-902c-4ee08ab65f0b', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8b2f2f-f98d-4e98-8b88-06306e0e5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8b2f2f-f98d-4e98-8b88-06306e0e5f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba68a328-2977-41aa-9ec7-41a34ad4acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:45 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume 6836482e-3e12-4a80-902c-4ee08ab65f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6836482e-3e12-4a80-902c-4ee08ab65f0b', 'volume_size': 1} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] creating volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume {'name': 'v_6836482e-3e12-4a80-902c-4ee08ab65f0b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6836482e-3e12-4a80-902c-4ee08ab65f0b', 'is_clone': False, 'name': 'v_6836482e-3e12-4a80-902c-4ee08ab65f0b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba68a328-2977-41aa-9ec7-41a34ad4acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6836482e-3e12-4a80-902c-4ee08ab65f0b', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fd51ca-b488-4d1f-adf2-11ceb33ce470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:46 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume volume-6836482e-3e12-4a80-902c-4ee08ab65f0b (6836482e-3e12-4a80-902c-4ee08ab65f0b): created successfully Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fd51ca-b488-4d1f-adf2-11ceb33ce470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (9e2c2420-a225-4405-861e-923491da9225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:46 user cinder-volume[84560]: INFO cinder.volume.manager [None req-076605d4-f284-41bc-8765-0aaf520ad04d tempest-CreateVolumesFromSnapshotTest-141588886 None] Created volume successfully. Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Flow 'volume_create_manager' (f021a500-25a7-4987-b2fc-c50d8d1267d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:46 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5deb8f9-e406-416a-9b33-b55ea3f0a8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5deb8f9-e406-416a-9b33-b55ea3f0a8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1849527662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6050cdd-8f4b-43f8-a339-caff26455d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90346b6861c4bc5a95530e40a2df8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:47Z,use_quota=True,user_id='85ecb6e96f3a470e95155dc7f719c53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b190109a-fba3-4918-92d5-86ace375eb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b190109a-fba3-4918-92d5-86ace375eb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f1900-8684-4f4a-b859-28c91392be60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (953f1900-8684-4f4a-b859-28c91392be60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6050cdd-8f4b-43f8-a339-caff26455d86', 'volume_name': 'volume-a6050cdd-8f4b-43f8-a339-caff26455d86', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92da5373-04bc-414f-ae1d-4df096e4bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92da5373-04bc-414f-ae1d-4df096e4bc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60409d89-2283-42ca-be18-f278f01635a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:47 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Volume a6050cdd-8f4b-43f8-a339-caff26455d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6050cdd-8f4b-43f8-a339-caff26455d86', 'volume_size': 1} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] creating volume v_a6050cdd-8f4b-43f8-a339-caff26455d86. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] create volume {'name': 'v_a6050cdd-8f4b-43f8-a339-caff26455d86', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] terminate connection for bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:19:47 user cinder-volume[84560]: INFO cinder.volume.manager [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Terminate volume connection completed successfully. Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Deleting attachment e467c4d8-36db-43d6-b51d-b2870d751a8e. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] remove_export for volume: bca83f34-5989-4188-abaa-205a9770d290. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1793016784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bca83f34-5989-4188-abaa-205a9770d290,launched_at=2023-04-14T00:19:37Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth='CHAP zWIOlNdw 57uEhk89Bx0J1m',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:35Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:19:46Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] detach volume v_bca83f34-5989-4188-abaa-205a9770d290 from target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a6050cdd-8f4b-43f8-a339-caff26455d86', 'is_clone': False, 'name': 'v_a6050cdd-8f4b-43f8-a339-caff26455d86'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60409d89-2283-42ca-be18-f278f01635a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6050cdd-8f4b-43f8-a339-caff26455d86', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05670d16-c86d-4378-8d91-8e05ed4d8dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:47 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Volume volume-a6050cdd-8f4b-43f8-a339-caff26455d86 (a6050cdd-8f4b-43f8-a339-caff26455d86): created successfully Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05670d16-c86d-4378-8d91-8e05ed4d8dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Flow 'volume_create_manager' (f021a500-25a7-4987-b2fc-c50d8d1267d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c85ebe27-32f1-4278-9e2b-0e591aa47189 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Created volume successfully. Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] delete target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] delete target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] create snapshot 9cbc9d71-91b0-4fec-af50-9f689dd984d4 for volume 6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] cloning v_6836482e-3e12-4a80-902c-4ee08ab65f0b to s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] create snapshot s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] create snapshot de58b469-7080-497f-a9fe-e89d2c931e9b for volume a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] cloning v_a6050cdd-8f4b-43f8-a339-caff26455d86 to s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] create snapshot s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-0bd88877-83e7-4a16-8fe4-f7da2326e034 req-1c378692-8c14-4c0d-b5b9-27a7ef70d87f tempest-AttachVolumeNegativeTest-719597397 None] target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_9cbc9d71-91b0-4fec-af50-9f689dd984d4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 from snapshot s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_de58b469-7080-497f-a9fe-e89d2c931e9b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] create volume s_de58b469-7080-497f-a9fe-e89d2c931e9b from snapshot s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a6050cdd-8f4b-43f8-a339-caff26455d86@s_de58b469-7080-497f-a9fe-e89d2c931e9b', 'is_clone': True, 'full_name': 'Pool-0/s_de58b469-7080-497f-a9fe-e89d2c931e9b', 'name': 's_de58b469-7080-497f-a9fe-e89d2c931e9b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6836482e-3e12-4a80-902c-4ee08ab65f0b@s_9cbc9d71-91b0-4fec-af50-9f689dd984d4', 'is_clone': True, 'full_name': 'Pool-0/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4', 'name': 's_9cbc9d71-91b0-4fec-af50-9f689dd984d4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] volume s_de58b469-7080-497f-a9fe-e89d2c931e9b properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:19:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4e3ee95c-efb8-4bbc-870d-8f10cba4f030 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Create snapshot completed successfully Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] volume s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:19:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9b2fc3af-3eb6-46b6-986d-08e66881bf28 tempest-CreateVolumesFromSnapshotTest-141588886 None] Create snapshot completed successfully Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (5ff036d9-5f0a-49b8-8dae-e9b1c7c40c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a920e8-3f4f-4707-bf2d-b19073711654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a920e8-3f4f-4707-bf2d-b19073711654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64444522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae94ce94-27ac-46ea-8faf-5fc9237de875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:51Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdd70b9-9f98-4182-85d9-004f87b1c921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cdd70b9-9f98-4182-85d9-004f87b1c921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3aefff-b17a-4689-82c2-a61ce0fdfdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3aefff-b17a-4689-82c2-a61ce0fdfdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae94ce94-27ac-46ea-8faf-5fc9237de875', 'volume_name': 'volume-ae94ce94-27ac-46ea-8faf-5fc9237de875', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b08745-54c0-4243-965f-a1eff352b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b08745-54c0-4243-965f-a1eff352b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4574be44-767d-4f6e-9e3f-ddce55b1eab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume ae94ce94-27ac-46ea-8faf-5fc9237de875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae94ce94-27ac-46ea-8faf-5fc9237de875', 'volume_size': 1} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] creating volume v_ae94ce94-27ac-46ea-8faf-5fc9237de875. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume {'name': 'v_ae94ce94-27ac-46ea-8faf-5fc9237de875', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Acquiring lock "cinder-de58b469-7080-497f-a9fe-e89d2c931e9b-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Lock "cinder-de58b469-7080-497f-a9fe-e89d2c931e9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] deleating snapshot s_de58b469-7080-497f-a9fe-e89d2c931e9b. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] get snapshots for volume s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (7d364b74-ce02-467a-b68f-bb9056122ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f272c7-1d22-4ff7-8430-ee73d3803d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f272c7-1d22-4ff7-8430-ee73d3803d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-234907186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cc12e02-da42-4547-bf60-8fa94586cfb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:51Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86744b2b-7848-43d0-a46b-bf35d1d8a1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86744b2b-7848-43d0-a46b-bf35d1d8a1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61f728-1f8c-4ae1-8753-5a27ce61cb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d61f728-1f8c-4ae1-8753-5a27ce61cb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cc12e02-da42-4547-bf60-8fa94586cfb3', 'volume_name': 'volume-6cc12e02-da42-4547-bf60-8fa94586cfb3', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03d7407-f952-45f4-bd48-ebabc417f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03d7407-f952-45f4-bd48-ebabc417f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67ca133-ddb9-488d-a2e9-0382a73a5e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:50 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume 6cc12e02-da42-4547-bf60-8fa94586cfb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cc12e02-da42-4547-bf60-8fa94586cfb3', 'volume_size': 1} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] creating volume v_6cc12e02-da42-4547-bf60-8fa94586cfb3. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume {'name': 'v_6cc12e02-da42-4547-bf60-8fa94586cfb3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (f2a5bf97-668b-4773-a38f-44b1e9c89474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affd4f06-74e4-493f-acd7-57a7b6812d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (affd4f06-74e4-493f-acd7-57a7b6812d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925140091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=03e50eda-2fa9-4d68-9708-364099358da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:51Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38ea34f-1dda-48e9-9df0-b0f802e6b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c38ea34f-1dda-48e9-9df0-b0f802e6b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28c38d5-f62c-44de-afd2-227de5ef7b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b28c38d5-f62c-44de-afd2-227de5ef7b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e50eda-2fa9-4d68-9708-364099358da8', 'volume_name': 'volume-03e50eda-2fa9-4d68-9708-364099358da8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94d4ec5-ab70-4965-bec1-c85f61ad2073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94d4ec5-ab70-4965-bec1-c85f61ad2073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f044980-7611-47f6-a2df-29f31323e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume 03e50eda-2fa9-4d68-9708-364099358da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e50eda-2fa9-4d68-9708-364099358da8', 'volume_size': 1} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] creating volume v_03e50eda-2fa9-4d68-9708-364099358da8. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume {'name': 'v_03e50eda-2fa9-4d68-9708-364099358da8', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] get volume s_de58b469-7080-497f-a9fe-e89d2c931e9b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (80d1ca36-acd9-4eda-b2a5-6e2891dbe05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5745aaaf-af77-4edb-b10b-e533bd50fcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5745aaaf-af77-4edb-b10b-e533bd50fcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1667252050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a27c4e34-8796-4ae8-8b45-599898fb4496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:51Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf1fd6a-0954-469c-b1e0-6ad93c09228c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf1fd6a-0954-469c-b1e0-6ad93c09228c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4987164c-4a66-476f-868d-0770f392ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4987164c-4a66-476f-868d-0770f392ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a27c4e34-8796-4ae8-8b45-599898fb4496', 'volume_name': 'volume-a27c4e34-8796-4ae8-8b45-599898fb4496', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec957e8-592b-4fce-9de1-eb096ed92832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dec957e8-592b-4fce-9de1-eb096ed92832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a50db3-d201-41b7-9ffe-101d3d51dc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume a27c4e34-8796-4ae8-8b45-599898fb4496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a27c4e34-8796-4ae8-8b45-599898fb4496', 'volume_size': 1} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] creating volume v_a27c4e34-8796-4ae8-8b45-599898fb4496. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume {'name': 'v_a27c4e34-8796-4ae8-8b45-599898fb4496', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ae94ce94-27ac-46ea-8faf-5fc9237de875', 'is_clone': False, 'name': 'v_ae94ce94-27ac-46ea-8faf-5fc9237de875'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4574be44-767d-4f6e-9e3f-ddce55b1eab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae94ce94-27ac-46ea-8faf-5fc9237de875', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c630f41-89c0-4670-8261-35089c763368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume volume-ae94ce94-27ac-46ea-8faf-5fc9237de875 (ae94ce94-27ac-46ea-8faf-5fc9237de875): created successfully Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c630f41-89c0-4670-8261-35089c763368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (5ff036d9-5f0a-49b8-8dae-e9b1c7c40c7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5ee0865a-01f4-4a1f-b910-746648e20dd9 tempest-CreateVolumesFromSnapshotTest-141588886 None] Created volume successfully. Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (49508b24-9ec6-4fc4-8661-698f499c40d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1e956a-6479-4c73-b244-1990c6c916e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e1e956a-6479-4c73-b244-1990c6c916e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981837472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7818b2f5-ec80-4074-b38b-a2e3589f14bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:52Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e237c6de-c31d-4f3c-83e6-cb0e7f94b0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e237c6de-c31d-4f3c-83e6-cb0e7f94b0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b12b1e-58b3-4afb-9298-4e4462e7e623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b12b1e-58b3-4afb-9298-4e4462e7e623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'volume_name': 'volume-7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cd3853-5a88-4d8f-8e00-22fef4a2a33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1cd3853-5a88-4d8f-8e00-22fef4a2a33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8268cbcb-5333-41b7-b472-61bec7b03224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume 7818b2f5-ec80-4074-b38b-a2e3589f14bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'volume_size': 1} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] creating volume v_7818b2f5-ec80-4074-b38b-a2e3589f14bd. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] create volume {'name': 'v_7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6cc12e02-da42-4547-bf60-8fa94586cfb3', 'is_clone': False, 'name': 'v_6cc12e02-da42-4547-bf60-8fa94586cfb3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67ca133-ddb9-488d-a2e9-0382a73a5e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cc12e02-da42-4547-bf60-8fa94586cfb3', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ab0af0-8579-4f09-ac85-c325fbfe98db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume volume-6cc12e02-da42-4547-bf60-8fa94586cfb3 (6cc12e02-da42-4547-bf60-8fa94586cfb3): created successfully Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ab0af0-8579-4f09-ac85-c325fbfe98db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (7d364b74-ce02-467a-b68f-bb9056122ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e51aabba-f7a0-444d-b48b-69def0837e8b tempest-CreateVolumesFromSnapshotTest-141588886 None] Created volume successfully. Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_03e50eda-2fa9-4d68-9708-364099358da8', 'is_clone': False, 'name': 'v_03e50eda-2fa9-4d68-9708-364099358da8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f044980-7611-47f6-a2df-29f31323e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e50eda-2fa9-4d68-9708-364099358da8', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c65ab1-4d99-4102-b1ec-8b91449cd082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume volume-03e50eda-2fa9-4d68-9708-364099358da8 (03e50eda-2fa9-4d68-9708-364099358da8): created successfully Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c65ab1-4d99-4102-b1ec-8b91449cd082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (f2a5bf97-668b-4773-a38f-44b1e9c89474) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-87884d8a-9a0a-4528-b43b-6358eb4e9e4e tempest-CreateVolumesFromSnapshotTest-141588886 None] Created volume successfully. Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_a6050cdd-8f4b-43f8-a339-caff26455d86@s_de58b469-7080-497f-a9fe-e89d2c931e9b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_de58b469-7080-497f-a9fe-e89d2c931e9b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432999', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108533', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '959857776831371317', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '189041fb4296fb2a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320838656', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80308', 'name': 's_de58b469-7080-497f-a9fe-e89d2c931e9b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] delete snapshot s_de58b469-7080-497f-a9fe-e89d2c931e9b of volume v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots/s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots/s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a27c4e34-8796-4ae8-8b45-599898fb4496', 'is_clone': False, 'name': 'v_a27c4e34-8796-4ae8-8b45-599898fb4496'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a50db3-d201-41b7-9ffe-101d3d51dc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a27c4e34-8796-4ae8-8b45-599898fb4496', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e19627-8ff6-4fcf-b31b-f2f779f28583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume volume-a27c4e34-8796-4ae8-8b45-599898fb4496 (a27c4e34-8796-4ae8-8b45-599898fb4496): created successfully Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e19627-8ff6-4fcf-b31b-f2f779f28583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (80d1ca36-acd9-4eda-b2a5-6e2891dbe05b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8aac2d71-3144-4383-b547-03b747c1f239 tempest-CreateVolumesFromSnapshotTest-141588886 None] Created volume successfully. Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'is_clone': False, 'name': 'v_7818b2f5-ec80-4074-b38b-a2e3589f14bd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8268cbcb-5333-41b7-b472-61bec7b03224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f864ea16-b8c2-493d-b264-466ee6cdecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Volume volume-7818b2f5-ec80-4074-b38b-a2e3589f14bd (7818b2f5-ec80-4074-b38b-a2e3589f14bd): created successfully Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f864ea16-b8c2-493d-b264-466ee6cdecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Flow 'volume_create_manager' (49508b24-9ec6-4fc4-8661-698f499c40d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-712ec151-74a3-4fae-b480-3db5f135560e tempest-CreateVolumesFromSnapshotTest-141588886 None] Created volume successfully. Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-7818b2f5-ec80-4074-b38b-a2e3589f14bd-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-7818b2f5-ec80-4074-b38b-a2e3589f14bd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:UPDATE=38,cinder:INSERT=2,cinder:DELETE=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] remove_export for volume: 7818b2f5-ec80-4074-b38b-a2e3589f14bd. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-981837472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7818b2f5-ec80-4074-b38b-a2e3589f14bd,launched_at=2023-04-14T00:19:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth='CHAP SVsLoKHr VbsWjMFGIvcnKp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:53Z,updated_at=2023-04-14T00:19:53Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume v_7818b2f5-ec80-4074-b38b-a2e3589f14bd from target iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd/luns/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd/luns/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd/luns/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd/luns/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd because of JDSS resource v_7818b2f5-ec80-4074-b38b-a2e3589f14bd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target: iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd because of JDSS resource iqn.2010-10.org.openstack:7818b2f5-ec80-4074-b38b-a2e3589f14bd DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating volume v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume v_7818b2f5-ec80-4074-b38b-a2e3589f14bd info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433001', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108553', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7098055202307699962', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cbe1d3fce0203bfc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320814080', 'san:volume_id': 'cbe1d3fce0203bfcd8dad807f32d4eacf1fdff9c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80323', 'name': 'v_7818b2f5-ec80-4074-b38b-a2e3589f14bd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] delete volume:v_7818b2f5-ec80-4074-b38b-a2e3589f14bd recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots/s_de58b469-7080-497f-a9fe-e89d2c931e9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] snapshot s_de58b469-7080-497f-a9fe-e89d2c931e9b deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.quota [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Created reservations ['2aff2682-fadf-4216-a19e-ebded3df4447', '836418c4-f630-4ea2-a922-7e9aa5dac295', '76e0c019-e9cc-4c6a-9a69-2f1cf72cd3f4', 'fc7a90ff-070a-4e6a-b792-183259104ed5'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:53 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=71,cinder:DELETE=6,cinder:INSERT=4,cinder:UPDATE=19 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:19:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Delete snapshot completed successfully. Apr 14 00:19:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-165b73c3-0b76-4304-86dd-23d9b99d5c9e tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Lock "cinder-de58b469-7080-497f-a9fe-e89d2c931e9b-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Acquiring lock "cinder-a6050cdd-8f4b-43f8-a339-caff26455d86-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Lock "cinder-a6050cdd-8f4b-43f8-a339-caff26455d86-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] remove_export for volume: a6050cdd-8f4b-43f8-a339-caff26455d86. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1849527662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a6050cdd-8f4b-43f8-a339-caff26455d86,launched_at=2023-04-14T00:19:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90346b6861c4bc5a95530e40a2df8e7',provider_auth='CHAP ZhyxvHfs IWL45XZeDGdcai',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:47Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:55Z,updated_at=2023-04-14T00:19:55Z,use_quota=True,user_id='85ecb6e96f3a470e95155dc7f719c53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] detach volume v_a6050cdd-8f4b-43f8-a339-caff26455d86 from target iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86/luns/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86/luns/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86/luns/v_a6050cdd-8f4b-43f8-a339-caff26455d86'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86/luns/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] failed to remove resource iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 because of JDSS resource v_a6050cdd-8f4b-43f8-a339-caff26455d86 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] delete target: iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] delete target iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] failed to remove resource iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 because of JDSS resource iqn.2010-10.org.openstack:a6050cdd-8f4b-43f8-a339-caff26455d86 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] deleating volume v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] get snapshots for volume v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] get volume v_a6050cdd-8f4b-43f8-a339-caff26455d86 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a6050cdd-8f4b-43f8-a339-caff26455d86', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432997', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108522', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3183435020004704807', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6f0bfca6a3b42b51', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320896000', 'san:volume_id': '6f0bfca6a3b42b514db4c54749c870e5214ce76d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79165', 'name': 'v_a6050cdd-8f4b-43f8-a339-caff26455d86', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] delete volume:v_a6050cdd-8f4b-43f8-a339-caff26455d86 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Flow 'volume_create_manager' (87838ae3-dcc4-44cf-b9cf-7b0359217566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7cdd5a-1ae8-4366-82c1-38ebfef78e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7cdd5a-1ae8-4366-82c1-38ebfef78e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1213922821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b655c48b-aee0-40c4-ac42-831c9158148a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db306ef96f8649eb8e145c6c76fc91ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:56Z,use_quota=True,user_id='251b797be4e542338567dea3adc29aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc8e37e-d826-489a-bd98-2557dee7a15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcc8e37e-d826-489a-bd98-2557dee7a15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09056c3-981f-4b65-bb0d-e60afcab66cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09056c3-981f-4b65-bb0d-e60afcab66cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b655c48b-aee0-40c4-ac42-831c9158148a', 'volume_name': 'volume-b655c48b-aee0-40c4-ac42-831c9158148a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabbfc8f-5006-49e9-bc16-420c7779f4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabbfc8f-5006-49e9-bc16-420c7779f4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a9f1b4-3dc6-4dd4-8371-7211b8c2c93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:56 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Volume b655c48b-aee0-40c4-ac42-831c9158148a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b655c48b-aee0-40c4-ac42-831c9158148a', 'volume_size': 1} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] creating volume v_b655c48b-aee0-40c4-ac42-831c9158148a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] create volume {'name': 'v_b655c48b-aee0-40c4-ac42-831c9158148a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7818b2f5-ec80-4074-b38b-a2e3589f14bd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] volume v_7818b2f5-ec80-4074-b38b-a2e3589f14bd deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b655c48b-aee0-40c4-ac42-831c9158148a', 'is_clone': False, 'name': 'v_b655c48b-aee0-40c4-ac42-831c9158148a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20a9f1b4-3dc6-4dd4-8371-7211b8c2c93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b655c48b-aee0-40c4-ac42-831c9158148a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f4d83e-e540-4dc5-9623-4ba4df976400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:57 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Volume volume-b655c48b-aee0-40c4-ac42-831c9158148a (b655c48b-aee0-40c4-ac42-831c9158148a): created successfully Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f4d83e-e540-4dc5-9623-4ba4df976400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Flow 'volume_create_manager' (87838ae3-dcc4-44cf-b9cf-7b0359217566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:57 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3380dc69-28bc-4446-81e0-86bceb5fbc19 tempest-VolumesListTestJSON-462985463 None] Created volume successfully. Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.quota [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['b360c73f-4dfb-495b-9a8b-b2bbc4fd735d', 'a1347a19-adcf-409d-a49f-e9fd87972c87', 'b0ca1845-026f-40c2-a631-6f75c4b30b7f', '1d043434-f0be-4450-90e4-e045e1cb9ee6'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'available': '114320891904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.manager [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:19:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Deleted volume successfully. Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-214c1e1a-c4f7-43ec-aa23-714df16d9eaa tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-7818b2f5-ec80-4074-b38b-a2e3589f14bd-delete_volume" released by "delete_volume" :: held 5.169s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-a27c4e34-8796-4ae8-8b45-599898fb4496-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-a27c4e34-8796-4ae8-8b45-599898fb4496-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove_export for volume: a27c4e34-8796-4ae8-8b45-599898fb4496. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1667252050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a27c4e34-8796-4ae8-8b45-599898fb4496,launched_at=2023-04-14T00:19:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth='CHAP lrsgDWoV IofQPNUADix3Vh',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:19:59Z,updated_at=2023-04-14T00:19:59Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume v_a27c4e34-8796-4ae8-8b45-599898fb4496 from target iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496/luns/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496/luns/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496/luns/v_a27c4e34-8796-4ae8-8b45-599898fb4496'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496/luns/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 because of JDSS resource v_a27c4e34-8796-4ae8-8b45-599898fb4496 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target: iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 because of JDSS resource iqn.2010-10.org.openstack:a27c4e34-8796-4ae8-8b45-599898fb4496 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating volume v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Flow 'volume_create_manager' (0594ea92-ce94-42c4-8de1-c97b0637239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611c65e6-5dae-4b51-b709-cf9a8a0d6cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (611c65e6-5dae-4b51-b709-cf9a8a0d6cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17193352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db306ef96f8649eb8e145c6c76fc91ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:19:59Z,use_quota=True,user_id='251b797be4e542338567dea3adc29aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1961c0ef-effa-4ab0-9f44-49cb778616f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1961c0ef-effa-4ab0-9f44-49cb778616f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b7ad18-c658-4a83-8287-18a5144075f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2b7ad18-c658-4a83-8287-18a5144075f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'volume_name': 'volume-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e324be41-2570-41e1-b649-0af792040485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e324be41-2570-41e1-b649-0af792040485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2464317d-cd12-47ce-ae06-b6d87b8f0cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:58 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Volume 9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'volume_size': 1} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] creating volume v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] create volume {'name': 'v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume v_a27c4e34-8796-4ae8-8b45-599898fb4496 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a27c4e34-8796-4ae8-8b45-599898fb4496', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433001', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108548', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4809142395927689772', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '02de78ecc401efa9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320891904', 'san:volume_id': '02de78ecc401efa9a6f4119357f76fbcf367d0db', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79784', 'name': 'v_a27c4e34-8796-4ae8-8b45-599898fb4496', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete volume:v_a27c4e34-8796-4ae8-8b45-599898fb4496 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'is_clone': False, 'name': 'v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2464317d-cd12-47ce-ae06-b6d87b8f0cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd00a98-6102-435d-99a9-7578b2e0bf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:19:59 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Volume volume-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d (9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d): created successfully Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd00a98-6102-435d-99a9-7578b2e0bf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:19:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Flow 'volume_create_manager' (0594ea92-ce94-42c4-8de1-c97b0637239a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:19:59 user cinder-volume[84560]: INFO cinder.volume.manager [None req-19346024-b986-4527-b80c-2ec2d68322c5 tempest-VolumesListTestJSON-462985463 None] Created volume successfully. Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a6050cdd-8f4b-43f8-a339-caff26455d86 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] volume v_a6050cdd-8f4b-43f8-a339-caff26455d86 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Created reservations ['bf4ab61a-f74e-4d14-b4d5-5360a82c86c7', 'e3fd41bb-fc1c-443a-aa24-ff6b590462d5', '5be1ae9e-d61e-40c2-9971-fed27030c53d', '93b8b14b-d8db-48cd-afc6-3721b6484106'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a27c4e34-8796-4ae8-8b45-599898fb4496 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] volume v_a27c4e34-8796-4ae8-8b45-599898fb4496 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['a9e01322-46c6-4f95-979c-601496012542', '3dd81b47-d825-4015-93e5-9b37ecdbcc12', 'd1789bf8-0607-4fc1-9b55-9387aabbf9c0', '6157fd00-6327-447f-b7ba-ff7dfd0ef9ad'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=51,cinder:INSERT=8,cinder:UPDATE=40,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'available': '114320891904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.manager [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:00 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Deleted volume successfully. Apr 14 00:20:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-fe566f9d-e0c9-43c3-896a-3e88f51024a0 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-a27c4e34-8796-4ae8-8b45-599898fb4496-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Geting {'code': 200, 'error': None, 'data': {'available': '114320891904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.manager [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Deleted volume successfully. Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1bcdeb2b-8f74-434a-bb87-998f401e2698 tempest-VolumeSnapshotQuotasNegativeTestJSON-1341040744 None] Lock "cinder-a6050cdd-8f4b-43f8-a339-caff26455d86-delete_volume" released by "delete_volume" :: held 6.055s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Flow 'volume_create_manager' (81e775e8-9aea-4d1b-972d-587711636555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5376f57-6602-4aa3-ae96-ea092144f54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5376f57-6602-4aa3-ae96-ea092144f54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-644421223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a2e0988f-1776-46c7-8009-cceb0adc0672,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db306ef96f8649eb8e145c6c76fc91ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:20:01Z,use_quota=True,user_id='251b797be4e542338567dea3adc29aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0249aad4-735e-44ce-b560-f28183512102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0249aad4-735e-44ce-b560-f28183512102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fabc80-079a-4ea2-9712-788c310017c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fabc80-079a-4ea2-9712-788c310017c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e0988f-1776-46c7-8009-cceb0adc0672', 'volume_name': 'volume-a2e0988f-1776-46c7-8009-cceb0adc0672', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7555e8a4-306d-4e93-b938-c4334811103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7555e8a4-306d-4e93-b938-c4334811103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f4ec5f-ea44-482a-bec8-23078af49fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:01 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Volume a2e0988f-1776-46c7-8009-cceb0adc0672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e0988f-1776-46c7-8009-cceb0adc0672', 'volume_size': 1} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] creating volume v_a2e0988f-1776-46c7-8009-cceb0adc0672. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] create volume {'name': 'v_a2e0988f-1776-46c7-8009-cceb0adc0672', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-03e50eda-2fa9-4d68-9708-364099358da8-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-03e50eda-2fa9-4d68-9708-364099358da8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove_export for volume: 03e50eda-2fa9-4d68-9708-364099358da8. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1925140091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=03e50eda-2fa9-4d68-9708-364099358da8,launched_at=2023-04-14T00:19:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth='CHAP XPqfaRSn KrMEbdDxFjuXBH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:02Z,updated_at=2023-04-14T00:20:02Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume v_03e50eda-2fa9-4d68-9708-364099358da8 from target iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8/luns/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8/luns/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8/luns/v_03e50eda-2fa9-4d68-9708-364099358da8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8/luns/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 because of JDSS resource v_03e50eda-2fa9-4d68-9708-364099358da8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target: iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 because of JDSS resource iqn.2010-10.org.openstack:03e50eda-2fa9-4d68-9708-364099358da8 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating volume v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_a2e0988f-1776-46c7-8009-cceb0adc0672', 'is_clone': False, 'name': 'v_a2e0988f-1776-46c7-8009-cceb0adc0672'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f4ec5f-ea44-482a-bec8-23078af49fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e0988f-1776-46c7-8009-cceb0adc0672', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26b41b7-da0a-49d6-b8a1-6f737b514e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:02 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Volume volume-a2e0988f-1776-46c7-8009-cceb0adc0672 (a2e0988f-1776-46c7-8009-cceb0adc0672): created successfully Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d26b41b7-da0a-49d6-b8a1-6f737b514e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Flow 'volume_create_manager' (81e775e8-9aea-4d1b-972d-587711636555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume v_03e50eda-2fa9-4d68-9708-364099358da8 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9e20fa34-1905-4e65-b1cb-9a5b0ba18d84 tempest-VolumesListTestJSON-462985463 None] Created volume successfully. Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_03e50eda-2fa9-4d68-9708-364099358da8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433001', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108545', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6132058141501759623', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3717071ebc921b27', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320809984', 'san:volume_id': '3717071ebc921b27f21375f961d4e3aa3b5efaaf', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80030', 'name': 'v_03e50eda-2fa9-4d68-9708-364099358da8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete volume:v_03e50eda-2fa9-4d68-9708-364099358da8 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_03e50eda-2fa9-4d68-9708-364099358da8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] volume v_03e50eda-2fa9-4d68-9708-364099358da8 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.quota [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['b24b8b9e-ddea-4c80-a006-d759dad410d2', '4ac961b3-9dae-4381-8c88-01c0b43e09c0', '5decf996-8d8c-4050-9cce-12627bca4f24', '6b1d31a2-694f-4c92-a811-f2fbf21d1be9'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=56,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'available': '114320891904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.manager [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:05 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Deleted volume successfully. Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0eaf716a-0d34-4439-bb8f-49199908fdd1 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-03e50eda-2fa9-4d68-9708-364099358da8-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-6cc12e02-da42-4547-bf60-8fa94586cfb3-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-6cc12e02-da42-4547-bf60-8fa94586cfb3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove_export for volume: 6cc12e02-da42-4547-bf60-8fa94586cfb3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-234907186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6cc12e02-da42-4547-bf60-8fa94586cfb3,launched_at=2023-04-14T00:19:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth='CHAP iImbYXHr Cao2RNPz9wOuLM',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:05Z,updated_at=2023-04-14T00:20:06Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume v_6cc12e02-da42-4547-bf60-8fa94586cfb3 from target iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3/luns/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3/luns/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3/luns/v_6cc12e02-da42-4547-bf60-8fa94586cfb3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3/luns/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 because of JDSS resource v_6cc12e02-da42-4547-bf60-8fa94586cfb3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target: iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 because of JDSS resource iqn.2010-10.org.openstack:6cc12e02-da42-4547-bf60-8fa94586cfb3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating volume v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Acquiring lock "cinder-a2e0988f-1776-46c7-8009-cceb0adc0672-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume v_6cc12e02-da42-4547-bf60-8fa94586cfb3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Lock "cinder-a2e0988f-1776-46c7-8009-cceb0adc0672-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6cc12e02-da42-4547-bf60-8fa94586cfb3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433001', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108541', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13134338293992578896', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b0ce76edd0d8620', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320891904', 'san:volume_id': '2b0ce76edd0d8620ab0c19f87d8e6a76be6f3370', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79776', 'name': 'v_6cc12e02-da42-4547-bf60-8fa94586cfb3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete volume:v_6cc12e02-da42-4547-bf60-8fa94586cfb3 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] remove_export for volume: a2e0988f-1776-46c7-8009-cceb0adc0672. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-644421223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a2e0988f-1776-46c7-8009-cceb0adc0672,launched_at=2023-04-14T00:20:02Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db306ef96f8649eb8e145c6c76fc91ff',provider_auth='CHAP EkhliKZR U9kESWBLdjoFK5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:01Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:06Z,updated_at=2023-04-14T00:20:06Z,use_quota=True,user_id='251b797be4e542338567dea3adc29aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] detach volume v_a2e0988f-1776-46c7-8009-cceb0adc0672 from target iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672/luns/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672/luns/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672/luns/v_a2e0988f-1776-46c7-8009-cceb0adc0672'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672/luns/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] failed to remove resource iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 because of JDSS resource v_a2e0988f-1776-46c7-8009-cceb0adc0672 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] delete target: iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] delete target iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] failed to remove resource iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 because of JDSS resource iqn.2010-10.org.openstack:a2e0988f-1776-46c7-8009-cceb0adc0672 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] deleating volume v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] get snapshots for volume v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] get volume v_a2e0988f-1776-46c7-8009-cceb0adc0672 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a2e0988f-1776-46c7-8009-cceb0adc0672', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433011', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108573', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2003944100556473575', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b576576c9f28ad1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320891904', 'san:volume_id': '2b576576c9f28ad11c92db286c865df24c6045f0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80037', 'name': 'v_a2e0988f-1776-46c7-8009-cceb0adc0672', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] delete volume:v_a2e0988f-1776-46c7-8009-cceb0adc0672 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Flow 'volume_create_manager' (aa25977f-2e3b-4799-bb2a-43547e02f1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6e2f63-3f28-492b-bf6b-39a23ed279c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d6e2f63-3f28-492b-bf6b-39a23ed279c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-46210180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4132a91b-23cd-43ff-bbee-11c8c0fdbcee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61155f144694496f9a23dc9d366df12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:20:08Z,use_quota=True,user_id='d6d372677be64e638e50e4122261a836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1ecce5-c4ce-45dc-b06f-ee69e252f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc1ecce5-c4ce-45dc-b06f-ee69e252f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5d9a1b-8f4d-4deb-a47d-fba5ffe5bc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be5d9a1b-8f4d-4deb-a47d-fba5ffe5bc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'volume_name': 'volume-4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8d7b38-3681-4c11-b5ca-2755bd2019f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8d7b38-3681-4c11-b5ca-2755bd2019f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b43d5b-7ac5-4484-9cba-c4612576b970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:07 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Volume 4132a91b-23cd-43ff-bbee-11c8c0fdbcee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'volume_size': 1} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] creating volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] create volume {'name': 'v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6cc12e02-da42-4547-bf60-8fa94586cfb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] volume v_6cc12e02-da42-4547-bf60-8fa94586cfb3 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:07 user cinder-volume[84560]: DEBUG cinder.quota [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['67d53105-a4c2-4981-84e5-9f2b547cd77e', '46d0597e-67da-43d7-84a3-85e437e736e6', '812b61cb-65ca-4e76-97a5-ef79929fba94', 'dc80ff7e-1446-4bce-b44b-3c25f8136d71'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321055744', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.manager [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:08 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Deleted volume successfully. Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a72d582b-631f-43aa-90ae-e6aad81b1c94 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-6cc12e02-da42-4547-bf60-8fa94586cfb3-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.coordination [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-ae94ce94-27ac-46ea-8faf-5fc9237de875-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.coordination [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-ae94ce94-27ac-46ea-8faf-5fc9237de875-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove_export for volume: ae94ce94-27ac-46ea-8faf-5fc9237de875. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-64444522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ae94ce94-27ac-46ea-8faf-5fc9237de875,launched_at=2023-04-14T00:19:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth='CHAP haVUXjNs rf5h1y4IDuqFC8',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:09Z,updated_at=2023-04-14T00:20:09Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume v_ae94ce94-27ac-46ea-8faf-5fc9237de875 from target iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875/luns/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875/luns/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875/luns/v_ae94ce94-27ac-46ea-8faf-5fc9237de875'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875/luns/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 because of JDSS resource v_ae94ce94-27ac-46ea-8faf-5fc9237de875 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target: iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 because of JDSS resource iqn.2010-10.org.openstack:ae94ce94-27ac-46ea-8faf-5fc9237de875 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating volume v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'is_clone': False, 'name': 'v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3b43d5b-7ac5-4484-9cba-c4612576b970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7691afe1-a752-4f78-9bef-211bc55de71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:08 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Volume volume-4132a91b-23cd-43ff-bbee-11c8c0fdbcee (4132a91b-23cd-43ff-bbee-11c8c0fdbcee): created successfully Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7691afe1-a752-4f78-9bef-211bc55de71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Flow 'volume_create_manager' (aa25977f-2e3b-4799-bb2a-43547e02f1b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:08 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3bb87d49-1503-4ee4-852c-464e161e4033 tempest-VolumesDeleteCascade-70057777 None] Created volume successfully. Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a2e0988f-1776-46c7-8009-cceb0adc0672 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] volume v_a2e0988f-1776-46c7-8009-cceb0adc0672 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.quota [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Created reservations ['1b3f73c3-4e32-4105-b0d9-4518d3d4322a', '4e1c9e39-9817-4baf-bb9e-91fcc74dfc27', '4ab3bdb7-73d5-4db1-a45a-20a014839af9', 'be8e9d3d-3fd6-41f4-bb45-b1322c21628b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume v_ae94ce94-27ac-46ea-8faf-5fc9237de875 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ae94ce94-27ac-46ea-8faf-5fc9237de875', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433000', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108538', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2269158698415333717', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6a1b02dbf1335c89', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320973824', 'san:volume_id': '6a1b02dbf1335c89cb9070265e24bbc4c44ec114', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79768', 'name': 'v_ae94ce94-27ac-46ea-8faf-5fc9237de875', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] delete volume:v_ae94ce94-27ac-46ea-8faf-5fc9237de875 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Acquiring lock "cinder-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Lock "cinder-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] remove_export for volume: 9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-17193352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d,launched_at=2023-04-14T00:20:00Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db306ef96f8649eb8e145c6c76fc91ff',provider_auth='CHAP bgnhCQDd ZTDdUJhQsiruyV',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:59Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:09Z,updated_at=2023-04-14T00:20:09Z,use_quota=True,user_id='251b797be4e542338567dea3adc29aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] detach volume v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d from target iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/luns/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/luns/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/luns/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/luns/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] failed to remove resource iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d because of JDSS resource v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] delete target: iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] delete target iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] failed to remove resource iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d because of JDSS resource iqn.2010-10.org.openstack:9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] deleating volume v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] get snapshots for volume v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'available': '114320973824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.manager [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Deleted volume successfully. Apr 14 00:20:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d81c1dc1-ac18-4362-b1d6-278570b86af4 tempest-VolumesListTestJSON-462985463 None] Lock "cinder-a2e0988f-1776-46c7-8009-cceb0adc0672-delete_volume" released by "delete_volume" :: held 3.889s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] get volume v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433009', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108568', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '569647647396094382', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e25b157e5eb8f8e7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114320973824', 'san:volume_id': 'e25b157e5eb8f8e7a8aa0f1e017d5a3aa6d30a0d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79792', 'name': 'v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] delete volume:v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:DELETE=3,cinder:SELECT=58,cinder:UPDATE=35,cinder:INSERT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] create snapshot 1b531945-a555-49f7-ac6a-7e1e80e328f2 for volume 4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] cloning v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee to s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] create snapshot s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ae94ce94-27ac-46ea-8faf-5fc9237de875 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] volume v_ae94ce94-27ac-46ea-8faf-5fc9237de875 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.quota [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['2b5fadcd-3cc2-42d7-80de-fc50aba2fef1', '267ba089-c54f-4be4-8b6a-e4d5f14c279e', '5ccb6c96-8783-409e-b091-d1ae990f1923', 'b239823c-0a46-4456-bc36-ea1741d0cf09'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1b531945-a555-49f7-ac6a-7e1e80e328f2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] create volume s_1b531945-a555-49f7-ac6a-7e1e80e328f2 from snapshot s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321113088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.manager [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:11 user cinder-volume[84560]: INFO cinder.volume.manager [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Deleted volume successfully. Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee@s_1b531945-a555-49f7-ac6a-7e1e80e328f2', 'is_clone': True, 'full_name': 'Pool-0/s_1b531945-a555-49f7-ac6a-7e1e80e328f2', 'name': 's_1b531945-a555-49f7-ac6a-7e1e80e328f2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.coordination [None req-de801d1d-241f-4d83-a607-bdbf5892c8e7 tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-ae94ce94-27ac-46ea-8faf-5fc9237de875-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] volume s_1b531945-a555-49f7-ac6a-7e1e80e328f2 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:20:11 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4bca507a-74a1-47a1-9e8f-b5caa5632b88 tempest-VolumesDeleteCascade-70057777 None] Create snapshot completed successfully Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-9cbc9d71-91b0-4fec-af50-9f689dd984d4-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-9cbc9d71-91b0-4fec-af50-9f689dd984d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating snapshot s_9cbc9d71-91b0-4fec-af50-9f689dd984d4. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] create snapshot 991be63d-f433-431e-87b3-c087bb4ef3b2 for volume 4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] cloning v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee to s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] create snapshot s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] volume v_9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=58,cinder:INSERT=10,cinder:UPDATE=28,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.quota [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Created reservations ['1cf7114e-eaf9-407c-adb9-6630a6996c7a', '621bbd92-73a7-4e64-be34-795ca5ff82e7', '151ff0e1-4947-45de-ad1b-da7d9754fdc4', '96377fab-fe96-410a-b2e4-de3f86690f49'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6836482e-3e12-4a80-902c-4ee08ab65f0b@s_9cbc9d71-91b0-4fec-af50-9f689dd984d4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432999', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108530', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11329819463293136338', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '2b2e1006c3e8d1a9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321113088', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80297', 'name': 's_9cbc9d71-91b0-4fec-af50-9f689dd984d4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] delete snapshot s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 of volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Acquiring lock "cinder-b655c48b-aee0-40c4-ac42-831c9158148a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Lock "cinder-b655c48b-aee0-40c4-ac42-831c9158148a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] remove_export for volume: b655c48b-aee0-40c4-ac42-831c9158148a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1213922821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b655c48b-aee0-40c4-ac42-831c9158148a,launched_at=2023-04-14T00:19:58Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='db306ef96f8649eb8e145c6c76fc91ff',provider_auth='CHAP WHSDswEN XSVqC3jP7OogvL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:56Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:13Z,updated_at=2023-04-14T00:20:13Z,use_quota=True,user_id='251b797be4e542338567dea3adc29aa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] detach volume v_b655c48b-aee0-40c4-ac42-831c9158148a from target iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a/luns/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a/luns/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321113088', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.manager [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Deleted volume successfully. Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.coordination [None req-33b38f04-cd3a-4e7d-ae9d-8c069cdd7a1a tempest-VolumesListTestJSON-462985463 None] Lock "cinder-9a82d4b8-c596-4eb6-9dc8-4b6ef1bb2f0d-delete_volume" released by "delete_volume" :: held 3.823s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_991be63d-f433-431e-87b3-c087bb4ef3b2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] create volume s_991be63d-f433-431e-87b3-c087bb4ef3b2 from snapshot s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots/s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] snapshot s_9cbc9d71-91b0-4fec-af50-9f689dd984d4 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a/luns/v_b655c48b-aee0-40c4-ac42-831c9158148a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a/luns/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] failed to remove resource iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a because of JDSS resource v_b655c48b-aee0-40c4-ac42-831c9158148a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] delete target: iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] delete target iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] failed to remove resource iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a because of JDSS resource iqn.2010-10.org.openstack:b655c48b-aee0-40c4-ac42-831c9158148a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] deleating volume v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] get snapshots for volume v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.quota [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['4b33e13a-62a9-434c-85ca-3d586dcebd80', '4cb1710c-47e4-4db9-b7e0-2103b77e6c66', 'b7252985-37fe-4a1e-b978-85cd6a296284', 'd6bfcdcb-0eae-4a04-9608-c67e11e23d31'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Delete snapshot completed successfully. Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-e54ffff5-90f1-4c74-b630-fc127ddba34c tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-9cbc9d71-91b0-4fec-af50-9f689dd984d4-delete_snapshot" released by "delete_snapshot" :: held 2.124s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee@s_991be63d-f433-431e-87b3-c087bb4ef3b2', 'is_clone': True, 'full_name': 'Pool-0/s_991be63d-f433-431e-87b3-c087bb4ef3b2', 'name': 's_991be63d-f433-431e-87b3-c087bb4ef3b2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] volume s_991be63d-f433-431e-87b3-c087bb4ef3b2 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:20:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fbbee788-8d01-4428-8fd6-08d1bf336eb0 tempest-VolumesDeleteCascade-70057777 None] Create snapshot completed successfully Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Acquiring lock "cinder-4132a91b-23cd-43ff-bbee-11c8c0fdbcee-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-4132a91b-23cd-43ff-bbee-11c8c0fdbcee-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] remove_export for volume: 4132a91b-23cd-43ff-bbee-11c8c0fdbcee. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-46210180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=4132a91b-23cd-43ff-bbee-11c8c0fdbcee,launched_at=2023-04-14T00:20:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61155f144694496f9a23dc9d366df12f',provider_auth='CHAP LTYzAaxd 2pn8oRsDYZFz0f',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:08Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:14Z,updated_at=2023-04-14T00:20:14Z,use_quota=True,user_id='d6d372677be64e638e50e4122261a836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] detach volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee from target iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee/luns/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee/luns/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee/luns/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee/luns/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] failed to remove resource iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee because of JDSS resource v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] delete target: iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] delete target iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] failed to remove resource iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee because of JDSS resource iqn.2010-10.org.openstack:4132a91b-23cd-43ff-bbee-11c8c0fdbcee DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Performing cascade delete. {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Acquiring lock "cinder-1b531945-a555-49f7-ac6a-7e1e80e328f2-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] get volume v_b655c48b-aee0-40c4-ac42-831c9158148a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-1b531945-a555-49f7-ac6a-7e1e80e328f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] deleating snapshot s_1b531945-a555-49f7-ac6a-7e1e80e328f2. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b655c48b-aee0-40c4-ac42-831c9158148a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433006', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108564', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6468645712961049380', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd8e3e15a6005aac4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321113088', 'san:volume_id': 'd8e3e15a6005aac4f5be41825427f31a94a9e181', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78301', 'name': 'v_b655c48b-aee0-40c4-ac42-831c9158148a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] delete volume:v_b655c48b-aee0-40c4-ac42-831c9158148a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] get volume s_1b531945-a555-49f7-ac6a-7e1e80e328f2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee@s_1b531945-a555-49f7-ac6a-7e1e80e328f2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1b531945-a555-49f7-ac6a-7e1e80e328f2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433020', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108588', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7457868542325718776', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a35d82485560ae06', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321113088', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80046', 'name': 's_1b531945-a555-49f7-ac6a-7e1e80e328f2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] delete snapshot s_1b531945-a555-49f7-ac6a-7e1e80e328f2 of volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots/s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots/s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Acquiring lock "cinder-6836482e-3e12-4a80-902c-4ee08ab65f0b-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-6836482e-3e12-4a80-902c-4ee08ab65f0b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] remove_export for volume: 6836482e-3e12-4a80-902c-4ee08ab65f0b. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-598410572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6836482e-3e12-4a80-902c-4ee08ab65f0b,launched_at=2023-04-14T00:19:47Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aefdc6ae88747139bb9f9ee25ae01cc',provider_auth='CHAP QbxyMNYC mYUnqEN10cjgdT',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:46Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:15Z,updated_at=2023-04-14T00:20:15Z,use_quota=True,user_id='08fbf328cc90468e84966692495ab8b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] detach volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b from target iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b/luns/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b/luns/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b655c48b-aee0-40c4-ac42-831c9158148a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] volume v_b655c48b-aee0-40c4-ac42-831c9158148a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b/luns/v_6836482e-3e12-4a80-902c-4ee08ab65f0b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b/luns/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b because of JDSS resource v_6836482e-3e12-4a80-902c-4ee08ab65f0b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target: iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] delete target iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.quota [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Created reservations ['7123d8c1-819a-4ffa-8b2a-4e5501021326', 'b67c0116-bed9-42a2-9498-9e54112f0ecf', 'aeeb1369-5a8f-4335-a693-18511062811c', '756f1a11-fe6f-46c9-9229-00819133b5c5'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] failed to remove resource iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b because of JDSS resource iqn.2010-10.org.openstack:6836482e-3e12-4a80-902c-4ee08ab65f0b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] deleating volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] get snapshots for volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots/s_1b531945-a555-49f7-ac6a-7e1e80e328f2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] snapshot s_1b531945-a555-49f7-ac6a-7e1e80e328f2 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.quota [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Created reservations ['04ab2dad-89db-43a2-b5fe-f79ae51b21df', '3821f4e2-0507-40c3-96e5-ec7277cdb75a', '499618aa-9e6a-4dc9-8f2b-82d77309dd09', '5254a444-cd45-499c-b570-bae1fd214951'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] get volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Delete snapshot completed successfully. Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-1b531945-a555-49f7-ac6a-7e1e80e328f2-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Acquiring lock "cinder-991be63d-f433-431e-87b3-c087bb4ef3b2-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-991be63d-f433-431e-87b3-c087bb4ef3b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] deleating snapshot s_991be63d-f433-431e-87b3-c087bb4ef3b2. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] get volume s_991be63d-f433-431e-87b3-c087bb4ef3b2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee@s_991be63d-f433-431e-87b3-c087bb4ef3b2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_991be63d-f433-431e-87b3-c087bb4ef3b2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433023', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108595', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5153875681556539450', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f2f73c5efafa2623', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321219584', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79414', 'name': 's_991be63d-f433-431e-87b3-c087bb4ef3b2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] delete snapshot s_991be63d-f433-431e-87b3-c087bb4ef3b2 of volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots/s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots/s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321219584', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.manager [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:17 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Deleted volume successfully. Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5597e3a6-25ad-44bc-9e37-41c3a5caf5ff tempest-VolumesListTestJSON-462985463 None] Lock "cinder-b655c48b-aee0-40c4-ac42-831c9158148a-delete_volume" released by "delete_volume" :: held 4.604s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6836482e-3e12-4a80-902c-4ee08ab65f0b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432996', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108518', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7551249300394338972', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '16e6cb0179fda241', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321207296', 'san:volume_id': '16e6cb0179fda241ca32c2978b2c9c3164c802fe', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80283', 'name': 'v_6836482e-3e12-4a80-902c-4ee08ab65f0b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] delete volume:v_6836482e-3e12-4a80-902c-4ee08ab65f0b recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots/s_991be63d-f433-431e-87b3-c087bb4ef3b2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] snapshot s_991be63d-f433-431e-87b3-c087bb4ef3b2 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.quota [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Created reservations ['7b295ea8-087a-4b7d-b49d-6419e5fcd9da', '7dbaae46-6ce5-4f22-8692-79ffc2c011f9', 'f5ac1833-40ad-454a-a714-6d1e1ab83564', 'd8c36c86-c7eb-4ba8-960c-1e3a8eaa27d1'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:18 user cinder-volume[84560]: INFO cinder.volume.manager [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Delete snapshot completed successfully. Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-991be63d-f433-431e-87b3-c087bb4ef3b2-delete_snapshot" released by "delete_snapshot" :: held 2.033s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Snapshots deleted, issuing volume delete {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] deleating volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6836482e-3e12-4a80-902c-4ee08ab65f0b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] volume v_6836482e-3e12-4a80-902c-4ee08ab65f0b deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=53,cinder:UPDATE=36,cinder:DELETE=1,cinder:INSERT=10 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.quota [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Created reservations ['71b6f8e4-cea7-40b6-a139-d5ffde4397b9', '1f6068ad-31d2-445d-8feb-a4af252dace9', '156b6710-ca1e-4ee9-b913-d9cfe57c3c19', 'ede70d4d-2362-4e21-9fd7-6249becb1043'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] get volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433018', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108580', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13512980176253013466', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c669cbec9c97679e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321350656', 'san:volume_id': 'c669cbec9c97679ea00d8889856421db66c268a5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80338', 'name': 'v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] delete volume:v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321350656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.manager [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Deleted volume successfully. Apr 14 00:20:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b5130f62-554d-4334-804e-d52e12bf0b8e tempest-CreateVolumesFromSnapshotTest-141588886 None] Lock "cinder-6836482e-3e12-4a80-902c-4ee08ab65f0b-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] create export for volume: 0c953a4d-d77b-4d17-bcad-ea49b45adbb9. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] ensure volume 0c953a4d-d77b-4d17-bcad-ea49b45adbb9 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] check if targe iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] create target and attach volume 0c953a4d-d77b-4d17-bcad-ea49b45adbb9 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] create target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] volume v_4132a91b-23cd-43ff-bbee-11c8c0fdbcee deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.quota [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Created reservations ['386238df-da48-4014-a726-810442171df5', '17d01f82-23b6-474c-94b5-2ca548d3875a', '88374d93-2f7d-49ba-87c9-d4c4d2686903', '4f097a58-d175-4e05-b2d9-d173e02bc9f7'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Flow 'volume_create_manager' (a8c5e3cf-c2da-4abb-8ca8-5d4a5b2e2c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b146e06e-83e4-422d-bcfc-5e836f9d7ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321432576', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:22 user cinder-volume[84560]: INFO cinder.volume.manager [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Deleted volume successfully. Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b146e06e-83e4-422d-bcfc-5e836f9d7ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-720312419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=184bede5-3d0e-48cc-b040-397310e5dcb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61155f144694496f9a23dc9d366df12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:20:22Z,use_quota=True,user_id='d6d372677be64e638e50e4122261a836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b11a2d8-5ca1-440f-b4df-30842151be4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b11a2d8-5ca1-440f-b4df-30842151be4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3c7c45-6ee3-426d-8e9b-b4772261d58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3c7c45-6ee3-426d-8e9b-b4772261d58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '184bede5-3d0e-48cc-b040-397310e5dcb3', 'volume_name': 'volume-184bede5-3d0e-48cc-b040-397310e5dcb3', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183ab29c-b865-4984-8b66-ac9a150d540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183ab29c-b865-4984-8b66-ac9a150d540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588ef792-d392-4502-b95e-d88762234703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:22 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Volume 184bede5-3d0e-48cc-b040-397310e5dcb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-184bede5-3d0e-48cc-b040-397310e5dcb3', 'volume_size': 1} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] creating volume v_184bede5-3d0e-48cc-b040-397310e5dcb3. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] create volume {'name': 'v_184bede5-3d0e-48cc-b040-397310e5dcb3', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aa5db55e-866d-471d-acce-245be11890a6 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-4132a91b-23cd-43ff-bbee-11c8c0fdbcee-delete_volume" released by "delete_volume" :: held 8.096s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_184bede5-3d0e-48cc-b040-397310e5dcb3', 'is_clone': False, 'name': 'v_184bede5-3d0e-48cc-b040-397310e5dcb3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588ef792-d392-4502-b95e-d88762234703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-184bede5-3d0e-48cc-b040-397310e5dcb3', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdae8df-fa0a-4d5b-b085-4830d5f20ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:23 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Volume volume-184bede5-3d0e-48cc-b040-397310e5dcb3 (184bede5-3d0e-48cc-b040-397310e5dcb3): created successfully Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bdae8df-fa0a-4d5b-b085-4830d5f20ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Flow 'volume_create_manager' (a8c5e3cf-c2da-4abb-8ca8-5d4a5b2e2c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:23 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7e0207d1-dab6-4a9a-a240-0b5e7d3d46c0 tempest-VolumesDeleteCascade-70057777 None] Created volume successfully. Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] atach volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 to target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] create snapshot acb19a18-0443-4eeb-8cef-9c9451a28991 for volume 184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] cloning v_184bede5-3d0e-48cc-b040-397310e5dcb3 to s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] create snapshot s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321350656', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_acb19a18-0443-4eeb-8cef-9c9451a28991'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] create volume s_acb19a18-0443-4eeb-8cef-9c9451a28991 from snapshot s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6334396636613565', 'lun': 0, 'mode': 'wt', 'name': 'v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'prod_id': 'Storage', 'scsi_id': 'c49f6a5e03f90ed1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] add credentails to target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_184bede5-3d0e-48cc-b040-397310e5dcb3@s_acb19a18-0443-4eeb-8cef-9c9451a28991', 'is_clone': True, 'full_name': 'Pool-0/s_acb19a18-0443-4eeb-8cef-9c9451a28991', 'name': 's_acb19a18-0443-4eeb-8cef-9c9451a28991'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] volume s_acb19a18-0443-4eeb-8cef-9c9451a28991 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:20:25 user cinder-volume[84560]: INFO cinder.volume.manager [None req-de38ad7c-2f67-4c12-9842-55fb0d9f34a5 tempest-VolumesDeleteCascade-70057777 None] Create snapshot completed successfully Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 201, 'error': None, 'data': {'name': 'RxsEKbZB'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] initialize_connection for 0c953a4d-d77b-4d17-bcad-ea49b45adbb9 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:20:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RxsEKbZB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a6056597-9848-4805-827e-8c95d7f7332e'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:20:25 user cinder-volume[84560]: INFO cinder.volume.manager [req-79dada32-ccc3-4094-b048-5f386a0d32e9 req-b6405d0f-7d86-4529-89f5-0e8d84addbbd tempest-ServerRescueNegativeTestJSON-1055458768 None] attachment_update completed successfully. Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Flow 'volume_create_manager' (1534da13-a350-4f46-982a-25a36aff3326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7ec67c-b5ee-44f7-bfff-8979138d1358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7ec67c-b5ee-44f7-bfff-8979138d1358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-217679663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e10bf43b-60db-4aad-a502-2d655a422048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61155f144694496f9a23dc9d366df12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=acb19a18-0443-4eeb-8cef-9c9451a28991,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:20:26Z,use_quota=True,user_id='d6d372677be64e638e50e4122261a836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d001811-cb2a-4e16-b462-0dac1be52395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d001811-cb2a-4e16-b462-0dac1be52395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90600e50-8081-46f5-927d-adb8765125c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90600e50-8081-46f5-927d-adb8765125c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e10bf43b-60db-4aad-a502-2d655a422048', 'volume_name': 'volume-e10bf43b-60db-4aad-a502-2d655a422048', 'volume_size': 1, 'snapshot_id': 'acb19a18-0443-4eeb-8cef-9c9451a28991'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405c94ae-2d02-48ea-89bc-0915f8f053fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405c94ae-2d02-48ea-89bc-0915f8f053fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d811f8a-559d-4a6a-a26a-a2b5748bd54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Volume e10bf43b-60db-4aad-a502-2d655a422048: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e10bf43b-60db-4aad-a502-2d655a422048', 'volume_size': 1, 'snapshot_id': 'acb19a18-0443-4eeb-8cef-9c9451a28991'} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] create volume e10bf43b-60db-4aad-a502-2d655a422048 from snapshot acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] cloning s_acb19a18-0443-4eeb-8cef-9c9451a28991 to v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] create snapshot v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e10bf43b-60db-4aad-a502-2d655a422048'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] create volume v_e10bf43b-60db-4aad-a502-2d655a422048 from snapshot v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:20:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_acb19a18-0443-4eeb-8cef-9c9451a28991@v_e10bf43b-60db-4aad-a502-2d655a422048', 'is_clone': True, 'full_name': 'Pool-0/v_e10bf43b-60db-4aad-a502-2d655a422048', 'name': 'v_e10bf43b-60db-4aad-a502-2d655a422048'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] get volume v_e10bf43b-60db-4aad-a502-2d655a422048 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_acb19a18-0443-4eeb-8cef-9c9451a28991@v_e10bf43b-60db-4aad-a502-2d655a422048', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e10bf43b-60db-4aad-a502-2d655a422048', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433037', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108629', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1217867463711210542', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '17806cd11bc6a91e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321289216', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80077', 'name': 'v_e10bf43b-60db-4aad-a502-2d655a422048', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d811f8a-559d-4a6a-a26a-a2b5748bd54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10bf43b-60db-4aad-a502-2d655a422048', 'volume_size': 1, 'snapshot_id': 'acb19a18-0443-4eeb-8cef-9c9451a28991'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bf9ef3-242a-4467-895d-d969be496696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:20:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Volume volume-e10bf43b-60db-4aad-a502-2d655a422048 (e10bf43b-60db-4aad-a502-2d655a422048): created successfully Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bf9ef3-242a-4467-895d-d969be496696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Flow 'volume_create_manager' (1534da13-a350-4f46-982a-25a36aff3326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:20:28 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8779867a-8fab-4fd4-92e6-fca13bd955df tempest-VolumesDeleteCascade-70057777 None] Created volume successfully. Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Acquiring lock "cinder-184bede5-3d0e-48cc-b040-397310e5dcb3-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-184bede5-3d0e-48cc-b040-397310e5dcb3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] remove_export for volume: 184bede5-3d0e-48cc-b040-397310e5dcb3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-720312419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=184bede5-3d0e-48cc-b040-397310e5dcb3,launched_at=2023-04-14T00:20:23Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61155f144694496f9a23dc9d366df12f',provider_auth='CHAP ZHDPglds yMzudKSnHgQ8G3',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:22Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:28Z,updated_at=2023-04-14T00:20:28Z,use_quota=True,user_id='d6d372677be64e638e50e4122261a836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] detach volume v_184bede5-3d0e-48cc-b040-397310e5dcb3 from target iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3/luns/v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3/luns/v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3/luns/v_184bede5-3d0e-48cc-b040-397310e5dcb3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3/luns/v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] failed to remove resource iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 because of JDSS resource v_184bede5-3d0e-48cc-b040-397310e5dcb3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] delete target: iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] delete target iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] failed to remove resource iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 because of JDSS resource iqn.2010-10.org.openstack:184bede5-3d0e-48cc-b040-397310e5dcb3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Performing cascade delete. {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1008}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Acquiring lock "cinder-acb19a18-0443-4eeb-8cef-9c9451a28991-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-acb19a18-0443-4eeb-8cef-9c9451a28991-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] deleating snapshot s_acb19a18-0443-4eeb-8cef-9c9451a28991. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:43:56', 'volsize': '1073741824', 'createtxg': '108628', 'guid': '16707164228029520503', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_e10bf43b-60db-4aad-a502-2d655a422048', 'objsetid': '80071', 'name': 'v_e10bf43b-60db-4aad-a502-2d655a422048', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] volume s_acb19a18-0443-4eeb-8cef-9c9451a28991 updated {{(pid=84560) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Created reservations ['42763448-432c-45a3-ba05-f61a9df3c721', 'df2201df-5a76-4c15-bcbc-6313d257e707', '0a4c51d8-ce38-4572-9d5b-4327c2f8aae7', '590c5eb1-fc15-4f14-8bc4-4d051e3f90e0'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Delete snapshot completed successfully. Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-acb19a18-0443-4eeb-8cef-9c9451a28991-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Snapshots deleted, issuing volume delete {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1023}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] deleating volume v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:43:53', 'volsize': '1073741824', 'createtxg': '108618', 'guid': '5519410077752775196', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_acb19a18-0443-4eeb-8cef-9c9451a28991', 'objsetid': '80054', 'name': 's_acb19a18-0443-4eeb-8cef-9c9451a28991', 'defer_destroy': 'off', 'san:volume_id': '9612b40c51056048b2579c98187772988163389b', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] volume v_184bede5-3d0e-48cc-b040-397310e5dcb3 updated {{(pid=84560) modify_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:267}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.quota [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Created reservations ['5b5d47ea-ab43-4dd1-9ae2-7734547a1bb9', 'c4c10c91-c9bc-44da-af5f-c6c3621a7261', '0d7de6c0-bef9-4762-be34-69a4893dede4', 'afbdbfa1-bffd-4ec8-a1f4-0ebb546854fd'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:INSERT=7,cinder:UPDATE=27,cinder:SELECT=62,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321276928', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.manager [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:20:33 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Deleted volume successfully. Apr 14 00:20:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-ac462ff4-b69d-45f0-bf56-e4e570f38711 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-184bede5-3d0e-48cc-b040-397310e5dcb3-delete_volume" released by "delete_volume" :: held 5.379s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Acquiring lock "cinder-e10bf43b-60db-4aad-a502-2d655a422048-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-e10bf43b-60db-4aad-a502-2d655a422048-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] remove_export for volume: e10bf43b-60db-4aad-a502-2d655a422048. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-217679663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e10bf43b-60db-4aad-a502-2d655a422048,launched_at=2023-04-14T00:20:28Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61155f144694496f9a23dc9d366df12f',provider_auth='CHAP dHhtNqUz DTqbZ2pwxLnRvc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:20:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=acb19a18-0443-4eeb-8cef-9c9451a28991,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:20:34Z,updated_at=2023-04-14T00:20:34Z,use_quota=True,user_id='d6d372677be64e638e50e4122261a836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] detach volume v_e10bf43b-60db-4aad-a502-2d655a422048 from target iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048/luns/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048/luns/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048/luns/v_e10bf43b-60db-4aad-a502-2d655a422048'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048/luns/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] failed to remove resource iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 because of JDSS resource v_e10bf43b-60db-4aad-a502-2d655a422048 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] delete target: iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] delete target iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] failed to remove resource iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 because of JDSS resource iqn.2010-10.org.openstack:e10bf43b-60db-4aad-a502-2d655a422048 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] deleating volume v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] get volume v_e10bf43b-60db-4aad-a502-2d655a422048 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_acb19a18-0443-4eeb-8cef-9c9451a28991@v_e10bf43b-60db-4aad-a502-2d655a422048', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e10bf43b-60db-4aad-a502-2d655a422048', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433037', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108629', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1217867463711210542', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '17806cd11bc6a91e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321276928', 'san:volume_id': '17806cd11bc6a91e9d6810f32b85775f2acc9696', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80077', 'name': 'v_e10bf43b-60db-4aad-a502-2d655a422048', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e10bf43b-60db-4aad-a502-2d655a422048 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume t_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:43:56', 'volsize': '1073741824', 'createtxg': '108628', 'guid': '16707164228029520503', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '0', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/v_e10bf43b-60db-4aad-a502-2d655a422048', 'objsetid': '80071', 'name': 'v_e10bf43b-60db-4aad-a502-2d655a422048', 'defer_destroy': 'off', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_acb19a18-0443-4eeb-8cef-9c9451a28991/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] get volume t_acb19a18-0443-4eeb-8cef-9c9451a28991 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/t_184bede5-3d0e-48cc-b040-397310e5dcb3@s_acb19a18-0443-4eeb-8cef-9c9451a28991', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_acb19a18-0443-4eeb-8cef-9c9451a28991', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433034', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108619', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11996732024059803638', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cc3a7162bcc3dbb7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321276928', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80060', 'name': 't_acb19a18-0443-4eeb-8cef-9c9451a28991', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_acb19a18-0443-4eeb-8cef-9c9451a28991 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] get snapshots for volume t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'results': 1, 'entries': [{'referenced': '57344', 'userrefs': '0', 'primarycache': 'all', 'creation': '2023-04-14 02:43:53', 'volsize': '1073741824', 'createtxg': '108618', 'guid': '5519410077752775196', 'compressratio': '1.00', 'rootcontext': 'none', 'encryption': 'off', 'defcontext': 'none', 'written': '57344', 'type': 'snapshot', 'secondarycache': 'all', 'used': '0', 'refcompressratio': '1.00', 'fscontext': 'none', 'clones': 'Pool-0/t_acb19a18-0443-4eeb-8cef-9c9451a28991', 'objsetid': '80054', 'name': 's_acb19a18-0443-4eeb-8cef-9c9451a28991', 'defer_destroy': 'off', 'san:volume_id': '9612b40c51056048b2579c98187772988163389b', 'mlslabel': 'none', 'logicalreferenced': '28672', 'context': 'none'}]}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] get volume t_184bede5-3d0e-48cc-b040-397310e5dcb3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/t_184bede5-3d0e-48cc-b040-397310e5dcb3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433032', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108613', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4175514319023857839', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9612b40c51056048', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321264640', 'san:volume_id': '9612b40c51056048b2579c98187772988163389b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79426', 'name': 't_184bede5-3d0e-48cc-b040-397310e5dcb3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] delete volume:t_184bede5-3d0e-48cc-b040-397310e5dcb3 recursively children:{'recursively_children': True, 'recursively_dependents': True, 'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Geting {'code': 500, 'error': {'class': 'opene.storage.zfs.ZfsOeError', 'message': 'In order to delete a zvol, you must delete all of its clones first.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/t_184bede5-3d0e-48cc-b040-397310e5dcb3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Lock "cinder-e10bf43b-60db-4aad-a502-2d655a422048-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server [None req-096159b1-c966-4820-a2df-d9a481af3672 tempest-VolumesDeleteCascade-70057777 None] Exception during message handling: KeyError: 'errno' Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 203, in wrapper Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server skip_clean = func(self, context, volume, *args, **kwargs) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/coordination.py", line 200, in _synchronized Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return f(*a, **k) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/decorator.py", line 232, in fun Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server return caller(func, *(extras + args), **kw) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/objects/cleanable.py", line 208, in wrapper Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server result = f(*args, **kwargs) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1035, in delete_volume Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self.force_reraise() Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server raise self.value Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 1026, in delete_volume Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self.driver.delete_volume(volume) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 286, in delete_volume Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self._gc_delete(vname) Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 305, in _gc_delete Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self._delete_back_recursively(jcom.origin_volume(vol['origin']), Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 369, in _delete_back_recursively Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self._delete_back_recursively( Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py", line 374, in _delete_back_recursively Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server self.ra.delete_lun(opvname, Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py", line 360, in delete_lun Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server if resp["error"]["errno"] == 1000: Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server KeyError: 'errno' Apr 14 00:20:36 user cinder-volume[84560]: ERROR oslo_messaging.rpc.server Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] create export for volume: 69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] ensure volume 69599ada-93d4-425a-ae12-e52cafcc29f7 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] check if targe iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] create target and attach volume 69599ada-93d4-425a-ae12-e52cafcc29f7 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] create target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] atach volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 to target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:20:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6630376635613839', 'lun': 0, 'mode': 'wt', 'name': 'v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'prod_id': 'Storage', 'scsi_id': 'f07f5a89696aa3f5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] add credentails to target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Geting {'code': 201, 'error': None, 'data': {'name': 'FZCpIqMc'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] initialize_connection for 69599ada-93d4-425a-ae12-e52cafcc29f7 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:20:42 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZCpIqMc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '869fd580-1919-4a5c-b29a-b85fcc14094b'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:20:42 user cinder-volume[84560]: INFO cinder.volume.manager [req-90939012-bce7-4d7e-ad99-12b48484f092 req-43476a5f-92eb-422f-ba10-c19da8591aa9 tempest-TestShelveInstance-5222591 None] attachment_update completed successfully. Apr 14 00:20:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=22,cinder:SELECT=40,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=24,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321268736', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:21:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Flow 'volume_create_manager' (a7112dc5-e026-4710-8abc-9125f08c06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96631617-08ae-42ae-a3f9-bc2b203b1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96631617-08ae-42ae-a3f9-bc2b203b1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-281846307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7056196a-d087-4a9b-a3c8-350b13e6d2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:21:24Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae349e6-680c-4c15-9fa6-666a536cbf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae349e6-680c-4c15-9fa6-666a536cbf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b7cef2-99f5-4d57-be51-2e73084c10f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b7cef2-99f5-4d57-be51-2e73084c10f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'volume_name': 'volume-7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e181ada-d7d0-4475-be37-76983963ba1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e181ada-d7d0-4475-be37-76983963ba1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56abd2d1-5fd3-4724-aa58-dc880075d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Cloning 7056196a-d087-4a9b-a3c8-350b13e6d2c3 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 21, 24, 372801)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 21, 24, 387600)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] create snapshot v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_7056196a-d087-4a9b-a3c8-350b13e6d2c3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] create volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 from snapshot v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:21:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'is_clone': True, 'full_name': 'Pool-0/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'name': 'v_7056196a-d087-4a9b-a3c8-350b13e6d2c3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] get volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433095', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108651', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10292363128037065970', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'd6ae34e51c0cba65', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321240064', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80138', 'name': 'v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Marking volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=11,cinder:UPDATE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Creating volume glance metadata for volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56abd2d1-5fd3-4724-aa58-dc880075d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82a8a28-2364-4690-a54e-112a6ccdd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Volume volume-7056196a-d087-4a9b-a3c8-350b13e6d2c3 (7056196a-d087-4a9b-a3c8-350b13e6d2c3): created successfully Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e82a8a28-2364-4690-a54e-112a6ccdd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Flow 'volume_create_manager' (a7112dc5-e026-4710-8abc-9125f08c06b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:21:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2219ffc9-5172-4056-901f-1ad3ff0cd3fe tempest-ServerActionsTestJSON-948553482 None] Created volume successfully. Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Acquiring lock "cinder-bca83f34-5989-4188-abaa-205a9770d290-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Lock "cinder-bca83f34-5989-4188-abaa-205a9770d290-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] remove_export for volume: bca83f34-5989-4188-abaa-205a9770d290. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:19:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1793016784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=bca83f34-5989-4188-abaa-205a9770d290,launched_at=2023-04-14T00:19:37Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth='CHAP zWIOlNdw 57uEhk89Bx0J1m',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:19:35Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:21:28Z,updated_at=2023-04-14T00:21:28Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] detach volume v_bca83f34-5989-4188-abaa-205a9770d290 from target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290/luns/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] failed to remove resource iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 because of JDSS resource v_bca83f34-5989-4188-abaa-205a9770d290 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] delete target: iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] delete target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] failed to remove resource iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 because of JDSS resource iqn.2010-10.org.openstack:bca83f34-5989-4188-abaa-205a9770d290 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] deleating volume v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] get snapshots for volume v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] get volume v_bca83f34-5989-4188-abaa-205a9770d290 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_bca83f34-5989-4188-abaa-205a9770d290', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432985', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108495', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2342754113827336454', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e12fc5c9d966b3de', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321240064', 'san:volume_id': 'e12fc5c9d966b3de034e3264880b6780fd72d59d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79964', 'name': 'v_bca83f34-5989-4188-abaa-205a9770d290', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] delete volume:v_bca83f34-5989-4188-abaa-205a9770d290 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] create export for volume: 7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] ensure volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_bca83f34-5989-4188-abaa-205a9770d290 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] volume v_bca83f34-5989-4188-abaa-205a9770d290 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.quota [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Created reservations ['2777caf8-0920-4cdc-9a0e-b765338da1ab', '4c0f859c-a11c-4221-81ad-50837b7c8d78', '84ee0db2-a5f5-48df-bd6d-a3067d8644fe', 'd8c37640-8e64-4a35-a8aa-edb16a9cd86c'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321321984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.manager [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:21:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Deleted volume successfully. Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5c7f69a7-e63b-4165-97f8-260c3c1d8cb3 tempest-AttachVolumeNegativeTest-719597397 None] Lock "cinder-bca83f34-5989-4188-abaa-205a9770d290-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Acquiring lock "cinder-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Lock "cinder-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] remove_export for volume: ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1532391028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1,launched_at=2023-04-14T00:15:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth='CHAP sfVBgCIN LNsI2zJyqH0gTx',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:15:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:21:31Z,updated_at=2023-04-14T00:21:31Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] detach volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 from target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/luns/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] failed to remove resource iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 because of JDSS resource v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] delete target: iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] delete target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] failed to remove resource iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 because of JDSS resource iqn.2010-10.org.openstack:ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] deleating volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] get snapshots for volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] get volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432759', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108263', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3858776881193827938', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '35fdd90b9c57647b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321321984', 'san:volume_id': '35fdd90b9c57647bfec7fc201d4e577ead049a98', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78286', 'name': 'v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] delete volume:v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] atach volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 to target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6436616533346535', 'lun': 0, 'mode': 'wt', 'name': 'v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'prod_id': 'Storage', 'scsi_id': 'd6ae34e51c0cba65'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:21:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] volume v_ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BcLTtdGe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 7056196a-d087-4a9b-a3c8-350b13e6d2c3 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.quota [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Created reservations ['69e90dae-fd4f-4369-a410-d1e860e53e10', '768bcfa8-4eac-4ceb-91e9-ee13f0cc70e5', '621347a6-3712-4bc1-81b5-d1bde85435f6', '394ded5f-6c3a-473a-ac2f-4cb0cebab5f8'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '979ee141-81ea-4ed1-85eb-7f12ebce14b6'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:34 user cinder-volume[84560]: INFO cinder.volume.manager [req-91d4f270-4b18-4185-8f49-9e9ea57ae89f req-f7267841-2f82-4e93-b274-2c7bbbd34f47 tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321403904', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.manager [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:21:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Deleted volume successfully. Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Acquiring lock "cinder-43ba2057-0822-4741-b91d-718067f21593-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b95da5b2-92a2-44e9-82ef-fff5cd7dad2d tempest-AttachVolumeNegativeTest-719597397 None] Lock "cinder-ee5f7aa1-05fe-47e8-8bd3-849fbe87aba1-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Lock "cinder-43ba2057-0822-4741-b91d-718067f21593-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] remove_export for volume: 43ba2057-0822-4741-b91d-718067f21593. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1511182728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=43ba2057-0822-4741-b91d-718067f21593,launched_at=2023-04-14T00:09:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44c9d67ad2fa4cb9ab309b98f8fe051a',provider_auth='CHAP dNQGcVbh CnDNO2fKFLzpQ5',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:09:13Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:21:35Z,updated_at=2023-04-14T00:21:35Z,use_quota=True,user_id='fb293fdfc658466aaa7134269fa46a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] detach volume v_43ba2057-0822-4741-b91d-718067f21593 from target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593/luns/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] failed to remove resource iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 because of JDSS resource v_43ba2057-0822-4741-b91d-718067f21593 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] delete target: iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] delete target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] failed to remove resource iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 because of JDSS resource iqn.2010-10.org.openstack:43ba2057-0822-4741-b91d-718067f21593 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] deleating volume v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] get snapshots for volume v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] get volume v_43ba2057-0822-4741-b91d-718067f21593 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_43ba2057-0822-4741-b91d-718067f21593', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432363', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108035', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '284154404030486415', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e4e242bfbbbca449', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321403904', 'san:volume_id': 'e4e242bfbbbca4492e4f4cf7ca97235a5e3a8c78', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78651', 'name': 'v_43ba2057-0822-4741-b91d-718067f21593', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] delete volume:v_43ba2057-0822-4741-b91d-718067f21593 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_43ba2057-0822-4741-b91d-718067f21593 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] volume v_43ba2057-0822-4741-b91d-718067f21593 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=64,cinder:UPDATE=22,cinder:INSERT=10,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.quota [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Created reservations ['0cf6835e-9e8c-4d96-a667-8ea1fadf5e72', '7aa1e7c1-7033-4e1b-a543-830e6d1191fa', '1ae1244e-8a0f-4396-a3a9-9c86ebf250fc', '0b95017a-28cf-43ff-8fab-9e4bc53ac419'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=57,cinder:INSERT=12,cinder:UPDATE=31 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321485824', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:21:38 user cinder-volume[84560]: DEBUG cinder.manager [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:21:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Deleted volume successfully. Apr 14 00:21:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a0427ab5-3d97-45eb-950e-3a27170c11c2 tempest-AttachVolumeNegativeTest-719597397 None] Lock "cinder-43ba2057-0822-4741-b91d-718067f21593-delete_volume" released by "delete_volume" :: held 3.083s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Flow 'volume_create_manager' (9e058bc8-c463-4298-89eb-3100bdca3f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fd084e-ebb1-4a57-9065-12fd49de2f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fd084e-ebb1-4a57-9065-12fd49de2f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1484701958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8a3ea69-2cde-4203-b5a9-659dc0690c9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3986cf5de73c4a4caf7daf44a5f6b647',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:21:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:21:52Z,use_quota=True,user_id='8c2450adf61c401796bbadaa7b0a1ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41444c4-7e26-4d0f-9848-0503973db3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b41444c4-7e26-4d0f-9848-0503973db3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0361699b-6120-466c-bdb6-0d84fb2c0665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0361699b-6120-466c-bdb6-0d84fb2c0665) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'volume_name': 'volume-d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'volume_size': 2}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409ac615-160b-42e5-aefd-517d1d9f84a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (409ac615-160b-42e5-aefd-517d1d9f84a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162d1b11-3e1d-4f86-b032-5494042f98d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Volume d8a3ea69-2cde-4203-b5a9-659dc0690c9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'volume_size': 2} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] creating volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] create volume {'name': 'v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'is_clone': False, 'name': 'v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162d1b11-3e1d-4f86-b032-5494042f98d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'volume_size': 2}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddc3a6-63ae-4f11-ac5b-ccf6333c53d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:21:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Volume volume-d8a3ea69-2cde-4203-b5a9-659dc0690c9a (d8a3ea69-2cde-4203-b5a9-659dc0690c9a): created successfully Apr 14 00:21:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ddc3a6-63ae-4f11-ac5b-ccf6333c53d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:21:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Flow 'volume_create_manager' (9e058bc8-c463-4298-89eb-3100bdca3f44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:21:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-82b5ae0c-a4b8-4cbc-b42f-e9473fe11f86 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Created volume successfully. Apr 14 00:21:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] create snapshot 0cd24046-861f-477e-84d9-3d03369d0b70 for volume d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:21:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] cloning v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a to s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:21:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] create snapshot s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:21:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_0cd24046-861f-477e-84d9-3d03369d0b70'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] create volume s_0cd24046-861f-477e-84d9-3d03369d0b70 from snapshot s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a@s_0cd24046-861f-477e-84d9-3d03369d0b70', 'is_clone': True, 'full_name': 'Pool-0/s_0cd24046-861f-477e-84d9-3d03369d0b70', 'name': 's_0cd24046-861f-477e-84d9-3d03369d0b70'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] volume s_0cd24046-861f-477e-84d9-3d03369d0b70 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:21:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-239d3541-0e85-4618-ab9b-6c21262db124 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Create snapshot completed successfully Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Acquiring lock "cinder-0cd24046-861f-477e-84d9-3d03369d0b70-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Lock "cinder-0cd24046-861f-477e-84d9-3d03369d0b70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] deleating snapshot s_0cd24046-861f-477e-84d9-3d03369d0b70. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] get snapshots for volume s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] get volume s_0cd24046-861f-477e-84d9-3d03369d0b70 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a@s_0cd24046-861f-477e-84d9-3d03369d0b70', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_0cd24046-861f-477e-84d9-3d03369d0b70', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433124', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108671', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13688578492769695447', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a60d2c81375065d5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114311233536', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80165', 'name': 's_0cd24046-861f-477e-84d9-3d03369d0b70', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] delete snapshot s_0cd24046-861f-477e-84d9-3d03369d0b70 of volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots/s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots/s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots/s_0cd24046-861f-477e-84d9-3d03369d0b70 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] snapshot s_0cd24046-861f-477e-84d9-3d03369d0b70 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:21:58 user cinder-volume[84560]: DEBUG cinder.quota [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Created reservations ['fec58dba-e58a-476d-a163-91a2598269ba', '2e59b3c6-498b-4daa-8b1f-075f7c3e163f', '6938d194-d43b-4531-9ca7-16e2c87f6c7d', '57fd0466-b789-438c-b583-93fae8c487a7'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:21:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Delete snapshot completed successfully. Apr 14 00:21:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-83cde5ce-59af-4f83-93e0-579f60006691 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Lock "cinder-0cd24046-861f-477e-84d9-3d03369d0b70-delete_snapshot" released by "delete_snapshot" :: held 2.456s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Acquiring lock "cinder-d8a3ea69-2cde-4203-b5a9-659dc0690c9a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Lock "cinder-d8a3ea69-2cde-4203-b5a9-659dc0690c9a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] remove_export for volume: d8a3ea69-2cde-4203-b5a9-659dc0690c9a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1484701958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8a3ea69-2cde-4203-b5a9-659dc0690c9a,launched_at=2023-04-14T00:21:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3986cf5de73c4a4caf7daf44a5f6b647',provider_auth='CHAP dRfgHCZz sJQlY9juoFyIC6',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:21:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:21:59Z,updated_at=2023-04-14T00:21:59Z,use_quota=True,user_id='8c2450adf61c401796bbadaa7b0a1ef7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] detach volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a from target iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a/luns/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a/luns/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a/luns/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a/luns/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] failed to remove resource iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a because of JDSS resource v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] delete target: iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] delete target iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] failed to remove resource iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a because of JDSS resource iqn.2010-10.org.openstack:d8a3ea69-2cde-4203-b5a9-659dc0690c9a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] deleating volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] get snapshots for volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] get volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:21:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433122', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108665', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15514175403964019985', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'fccfc6f1fe0897a8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114311233536', 'san:volume_id': 'fccfc6f1fe0897a831801c2c82b86b6d0f62c35e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80152', 'name': 'v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] delete volume:v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:22:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] volume v_d8a3ea69-2cde-4203-b5a9-659dc0690c9a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.quota [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Created reservations ['5ae818ce-de7b-4373-ab92-903c076d7a16', '56bb0fc6-c9a9-45bd-9231-2c6d10fde61c', 'fafef315-f7c6-4ee9-a73f-6a6849e39971', 'e1de7b94-c7bb-425f-ab4d-034bd2ec31ec'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Geting {'code': 200, 'error': None, 'data': {'available': '114311315456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:22:02 user cinder-volume[84560]: DEBUG cinder.manager [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:22:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Deleted volume successfully. Apr 14 00:22:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a1512a2a-3206-4d6d-8c65-69348612c1f2 tempest-VolumesSnapshotNegativeTestJSON-267026796 None] Lock "cinder-d8a3ea69-2cde-4203-b5a9-659dc0690c9a-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:22:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=40,cinder:INSERT=8,cinder:UPDATE=24 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=33,cinder:DELETE=4,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114311311360', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:22:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] terminate connection for 69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:22:30 user cinder-volume[84560]: INFO cinder.volume.manager [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Terminate volume connection completed successfully. Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Deleting attachment 869fd580-1919-4a5c-b29a-b85fcc14094b. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] remove_export for volume: 69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1491387094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=69599ada-93d4-425a-ae12-e52cafcc29f7,launched_at=2023-04-14T00:16:50Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='e6be95e5c8d94269802ecf487ff73104',provider_auth='CHAP FZCpIqMc YBMVW8jwfFc6td',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:48Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:20:43Z,use_quota=True,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] detach volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 from target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] delete target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] delete target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-984aa213-4369-4113-b56f-9e7cbe929364 tempest-TestShelveInstance-5222591 None] target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.coordination [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Acquiring lock "cinder-69599ada-93d4-425a-ae12-e52cafcc29f7-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.coordination [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Lock "cinder-69599ada-93d4-425a-ae12-e52cafcc29f7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] remove_export for volume: 69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1491387094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=69599ada-93d4-425a-ae12-e52cafcc29f7,launched_at=2023-04-14T00:16:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6be95e5c8d94269802ecf487ff73104',provider_auth='CHAP FZCpIqMc YBMVW8jwfFc6td',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:16:48Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:22:32Z,updated_at=2023-04-14T00:22:32Z,use_quota=True,user_id='b81e5ce5d2414980a506d0f3b37d0d5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] detach volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 from target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7/luns/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] failed to remove resource iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 because of JDSS resource v_69599ada-93d4-425a-ae12-e52cafcc29f7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] delete target: iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] delete target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] failed to remove resource iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 because of JDSS resource iqn.2010-10.org.openstack:69599ada-93d4-425a-ae12-e52cafcc29f7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] deleating volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] get snapshots for volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] get volume v_69599ada-93d4-425a-ae12-e52cafcc29f7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432819', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '108331', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4203884528210042509', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10145792', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': 'f07f5a89696aa3f5', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114311311360', 'san:volume_id': 'f07f5a89696aa3f5448db3d4de0c2a88394330d6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10145792', 'objsetid': '79313', 'name': 'v_69599ada-93d4-425a-ae12-e52cafcc29f7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10145792', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] delete snapshot v_69599ada-93d4-425a-ae12-e52cafcc29f7 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_69599ada-93d4-425a-ae12-e52cafcc29f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] snapshot v_69599ada-93d4-425a-ae12-e52cafcc29f7 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.quota [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Created reservations ['b8241d4f-3311-466f-ba3a-3164f6cb0b8f', 'd2a111cd-7454-4655-bc12-502566fd3880', '773425ac-ca89-40ca-a2d9-940b4812e77a', '0bd7ef22-6556-4ace-a05c-d9b25ae2e772'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321506304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.manager [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:22:34 user cinder-volume[84560]: INFO cinder.volume.manager [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Deleted volume successfully. Apr 14 00:22:34 user cinder-volume[84560]: DEBUG cinder.coordination [req-d0623ef6-c885-43cf-a123-984a940b758f req-54ff343b-46e0-44f4-b774-05c14a6f83be tempest-TestShelveInstance-5222591 None] Lock "cinder-69599ada-93d4-425a-ae12-e52cafcc29f7-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:22:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] terminate connection for 2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:22:50 user cinder-volume[84560]: INFO cinder.volume.manager [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Terminate volume connection completed successfully. Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Deleting attachment 9e5814ce-b181-44ee-877c-53333941f6ac. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] remove_export for volume: 2681b171-ba2b-44b0-8a6a-e89a52fafc99. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:17:18Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2681b171-ba2b-44b0-8a6a-e89a52fafc99,launched_at=2023-04-14T00:17:20Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ba3f111e24414976beddba7ef90c4793',provider_auth='CHAP NhaiJkPC K7XwzGlOc8IdQi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:17:18Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:17:27Z,use_quota=True,user_id='90bad96535c3453792982c5acab9dbc6',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] detach volume v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 from target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/luns/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/luns/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99/luns/v_2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] delete target: iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] delete target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:22:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-8c31b509-bce4-47d1-b56e-bc99114376bc req-9356a17a-1410-46cc-8a8c-63a40eda8b69 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] target iqn.2010-10.org.openstack:2681b171-ba2b-44b0-8a6a-e89a52fafc99 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:23:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:23:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:23:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:23:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321506304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:23:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] terminate connection for 7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:23:23 user cinder-volume[84560]: INFO cinder.volume.manager [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Deleting attachment 979ee141-81ea-4ed1-85eb-7f12ebce14b6. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-281846307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7056196a-d087-4a9b-a3c8-350b13e6d2c3,launched_at=2023-04-14T00:21:26Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP BcLTtdGe O3jcCRVaTHgipz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:21:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:21:34Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] detach volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 from target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-b4f980cb-f8a2-44b0-9f5f-130e941c96e7 tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] create export for volume: 7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] ensure volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] check if targe iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] create target and attach volume 7056196a-d087-4a9b-a3c8-350b13e6d2c3 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] create target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] atach volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 to target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:23:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:28 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (c89210e4-669f-4c0e-a5c6-0118015d5330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758afdec-eb7b-4af8-8b57-59626463862e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758afdec-eb7b-4af8-8b57-59626463862e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923674594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e32818c0-6db3-4ab6-91ae-3a1492a560f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:29Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0b3388-7c8c-4c13-acda-8f4f2cc4634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0b3388-7c8c-4c13-acda-8f4f2cc4634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f936e6-5e84-4c3d-8512-0fb144f2ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f936e6-5e84-4c3d-8512-0fb144f2ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'volume_name': 'volume-e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e93eb6f-d9b0-41b2-b604-54909c983af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e93eb6f-d9b0-41b2-b604-54909c983af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005d480c-0423-4263-a9e2-df44447d1c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Volume e32818c0-6db3-4ab6-91ae-3a1492a560f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'volume_size': 1} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] creating volume v_e32818c0-6db3-4ab6-91ae-3a1492a560f7. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] create volume {'name': 'v_e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (473b0d5a-a861-4e6d-b1e4-4061ea2814a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477b921a-f278-4bc9-8083-75f3a7e2bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477b921a-f278-4bc9-8083-75f3a7e2bd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913265352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1c1fedaf-d763-493e-8c18-d2b4b4700b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:29Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec20a39c-23d1-4505-8ddf-5648c7a5f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec20a39c-23d1-4505-8ddf-5648c7a5f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5a8c58-c8ce-418b-9e1e-7d5e026739f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5a8c58-c8ce-418b-9e1e-7d5e026739f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'volume_name': 'volume-1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d68926b-4725-44e4-a52c-2ca05580d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d68926b-4725-44e4-a52c-2ca05580d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b9febc-d38f-482d-ad2b-af1789fd1d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Volume 1c1fedaf-d763-493e-8c18-d2b4b4700b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'volume_size': 1} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] creating volume v_1c1fedaf-d763-493e-8c18-d2b4b4700b76. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] create volume {'name': 'v_1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6436616533346535', 'lun': 0, 'mode': 'wt', 'name': 'v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'prod_id': 'Storage', 'scsi_id': 'd6ae34e51c0cba65'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] add credentails to target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (2a5ebe26-9b51-4178-b004-d010d1c4d2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef4de1-5815-498f-80fb-e45eaaf9ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aef4de1-5815-498f-80fb-e45eaaf9ac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1058587707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0650570a-121d-4d8d-969d-c5c355436eb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:29Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eea81bd-dcc2-4383-87f8-1ad731d22ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eea81bd-dcc2-4383-87f8-1ad731d22ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb403a3d-b5a5-4cba-892c-a49f811c14ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb403a3d-b5a5-4cba-892c-a49f811c14ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0650570a-121d-4d8d-969d-c5c355436eb2', 'volume_name': 'volume-0650570a-121d-4d8d-969d-c5c355436eb2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd28eb4-ae7e-49cd-9380-1b7099790cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd28eb4-ae7e-49cd-9380-1b7099790cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5861688e-eded-4560-b7eb-25eab79944cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Volume 0650570a-121d-4d8d-969d-c5c355436eb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0650570a-121d-4d8d-969d-c5c355436eb2', 'volume_size': 1} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] creating volume v_0650570a-121d-4d8d-969d-c5c355436eb2. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] create volume {'name': 'v_0650570a-121d-4d8d-969d-c5c355436eb2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BcLTtdGe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] initialize_connection for 7056196a-d087-4a9b-a3c8-350b13e6d2c3 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BcLTtdGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'bdc31db9-2b5e-49a1-88c3-b26415140a22'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:23:29 user cinder-volume[84560]: INFO cinder.volume.manager [req-764dea3d-0de2-484f-b44b-a3da1002de09 req-4ac7e7d7-cdf8-4edc-b4dc-ee9eb23b5ef9 tempest-ServerActionsTestJSON-948553482 None] attachment_update completed successfully. Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (9dd329dd-0494-42cc-92ae-3add6f5403c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ce14b8-f41e-4218-8c05-4ce4c9e860a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ce14b8-f41e-4218-8c05-4ce4c9e860a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566541822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8ec47c6-2ce1-436d-b2d8-0302d688c29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:30Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4ce692-358d-4886-baed-24b50e66cea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4ce692-358d-4886-baed-24b50e66cea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db1160-2443-437d-8138-c9ceb418a85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6db1160-2443-437d-8138-c9ceb418a85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'volume_name': 'volume-d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14588066-55ef-4ad6-828b-21e8d4ed80e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14588066-55ef-4ad6-828b-21e8d4ed80e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef56d54-c5cd-4213-af65-a29f15c5bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:29 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Volume d8ec47c6-2ce1-436d-b2d8-0302d688c29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'volume_size': 1} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] creating volume v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] create volume {'name': 'v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'is_clone': False, 'name': 'v_e32818c0-6db3-4ab6-91ae-3a1492a560f7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005d480c-0423-4263-a9e2-df44447d1c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a824169-725a-4c27-ac62-11f7aeee5d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Volume volume-e32818c0-6db3-4ab6-91ae-3a1492a560f7 (e32818c0-6db3-4ab6-91ae-3a1492a560f7): created successfully Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a824169-725a-4c27-ac62-11f7aeee5d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (c89210e4-669f-4c0e-a5c6-0118015d5330) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-055dd600-4237-49c9-8d48-3781e6d4a315 tempest-CreateVolumesFromImageTest-1219950048 None] Created volume successfully. Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (cf48a923-f039-4509-b064-42f62a775bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88febecd-f97a-4f9b-9678-047c0618e9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88febecd-f97a-4f9b-9678-047c0618e9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234658712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=59c39548-0a5e-4cda-a49e-d82936990eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:30Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aac2a1-0c69-4f04-a196-dac1b0e542cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aac2a1-0c69-4f04-a196-dac1b0e542cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f3029a-8cd0-405c-be8d-ac8e778068e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f3029a-8cd0-405c-be8d-ac8e778068e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59c39548-0a5e-4cda-a49e-d82936990eba', 'volume_name': 'volume-59c39548-0a5e-4cda-a49e-d82936990eba', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924c0d31-55ab-4057-bc73-890d13dcafbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (924c0d31-55ab-4057-bc73-890d13dcafbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f700aa-656f-4b0f-9470-305d390896d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Volume 59c39548-0a5e-4cda-a49e-d82936990eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59c39548-0a5e-4cda-a49e-d82936990eba', 'volume_size': 1} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] creating volume v_59c39548-0a5e-4cda-a49e-d82936990eba. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] create volume {'name': 'v_59c39548-0a5e-4cda-a49e-d82936990eba', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'is_clone': False, 'name': 'v_1c1fedaf-d763-493e-8c18-d2b4b4700b76'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b9febc-d38f-482d-ad2b-af1789fd1d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8adfaa6-bab2-47d0-af03-2084eea1dc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:30 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Volume volume-1c1fedaf-d763-493e-8c18-d2b4b4700b76 (1c1fedaf-d763-493e-8c18-d2b4b4700b76): created successfully Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8adfaa6-bab2-47d0-af03-2084eea1dc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:30 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (473b0d5a-a861-4e6d-b1e4-4061ea2814a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3bbd8f12-3cb9-41f2-9cc4-16d5808250db tempest-CreateVolumesFromImageTest-1219950048 None] Created volume successfully. Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0650570a-121d-4d8d-969d-c5c355436eb2', 'is_clone': False, 'name': 'v_0650570a-121d-4d8d-969d-c5c355436eb2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'is_clone': False, 'name': 'v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5861688e-eded-4560-b7eb-25eab79944cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0650570a-121d-4d8d-969d-c5c355436eb2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155d55b8-8987-42ae-abbd-50bdfdc39ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef56d54-c5cd-4213-af65-a29f15c5bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd31a8a5-6169-4762-ace6-5966d76ac49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:31 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Volume volume-0650570a-121d-4d8d-969d-c5c355436eb2 (0650570a-121d-4d8d-969d-c5c355436eb2): created successfully Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155d55b8-8987-42ae-abbd-50bdfdc39ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (2a5ebe26-9b51-4178-b004-d010d1c4d2cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:31 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Volume volume-d8ec47c6-2ce1-436d-b2d8-0302d688c29a (d8ec47c6-2ce1-436d-b2d8-0302d688c29a): created successfully Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd31a8a5-6169-4762-ace6-5966d76ac49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (9dd329dd-0494-42cc-92ae-3add6f5403c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e1d55f34-4a8a-4fb4-a968-da9a3c5b3a2a tempest-CreateVolumesFromImageTest-1219950048 None] Created volume successfully. Apr 14 00:23:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-54cf3e71-32ba-4c6d-abe9-96c4c8c9f6a5 tempest-CreateVolumesFromImageTest-1219950048 None] Created volume successfully. Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_59c39548-0a5e-4cda-a49e-d82936990eba', 'is_clone': False, 'name': 'v_59c39548-0a5e-4cda-a49e-d82936990eba'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01f700aa-656f-4b0f-9470-305d390896d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59c39548-0a5e-4cda-a49e-d82936990eba', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166fed2f-a2ca-4425-be45-9d67a12687b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:31 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Volume volume-59c39548-0a5e-4cda-a49e-d82936990eba (59c39548-0a5e-4cda-a49e-d82936990eba): created successfully Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (166fed2f-a2ca-4425-be45-9d67a12687b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Flow 'volume_create_manager' (cf48a923-f039-4509-b064-42f62a775bd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:31 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ec78a40a-3e92-4264-a5f7-b70f1287e5c3 tempest-CreateVolumesFromImageTest-1219950048 None] Created volume successfully. Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.coordination [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Acquiring lock "cinder-59c39548-0a5e-4cda-a49e-d82936990eba-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.coordination [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-59c39548-0a5e-4cda-a49e-d82936990eba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] remove_export for volume: 59c39548-0a5e-4cda-a49e-d82936990eba. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1234658712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=59c39548-0a5e-4cda-a49e-d82936990eba,launched_at=2023-04-14T00:23:32Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth='CHAP ZByvCROb iz210WX7ZThyJA',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:30Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:23:32Z,updated_at=2023-04-14T00:23:32Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume v_59c39548-0a5e-4cda-a49e-d82936990eba from target iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba/luns/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba/luns/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba/luns/v_59c39548-0a5e-4cda-a49e-d82936990eba'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba/luns/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba because of JDSS resource v_59c39548-0a5e-4cda-a49e-d82936990eba DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] delete target: iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] delete target iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba because of JDSS resource iqn.2010-10.org.openstack:59c39548-0a5e-4cda-a49e-d82936990eba DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] deleating volume v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] get snapshots for volume v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] get volume v_59c39548-0a5e-4cda-a49e-d82936990eba info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_59c39548-0a5e-4cda-a49e-d82936990eba', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433221', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108729', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5920030506068421582', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '049c3edbb06a8810', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321108992', 'san:volume_id': '049c3edbb06a881038b5386788008781f1748015', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79193', 'name': 'v_59c39548-0a5e-4cda-a49e-d82936990eba', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] delete volume:v_59c39548-0a5e-4cda-a49e-d82936990eba recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_59c39548-0a5e-4cda-a49e-d82936990eba {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] volume v_59c39548-0a5e-4cda-a49e-d82936990eba deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.quota [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Created reservations ['bf6ef5d7-b9e2-4a36-95fc-6a6a235f3ee3', '117ff202-4392-438d-ada8-7a63b27f3d5e', '61d46dd9-5ffb-449a-b880-6a4a89eb3eba', 'bb0ace68-b72a-4919-b7bd-d683ba8e77d8'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321215488', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.manager [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:23:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Deleted volume successfully. Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Acquiring lock "cinder-d8ec47c6-2ce1-436d-b2d8-0302d688c29a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-379c7a3c-9d4c-4788-b584-a7d7393fd551 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-59c39548-0a5e-4cda-a49e-d82936990eba-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-d8ec47c6-2ce1-436d-b2d8-0302d688c29a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] remove_export for volume: d8ec47c6-2ce1-436d-b2d8-0302d688c29a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1566541822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=d8ec47c6-2ce1-436d-b2d8-0302d688c29a,launched_at=2023-04-14T00:23:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth='CHAP wbtAsoim 7fO0vWZdTu2KkL',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:30Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:23:36Z,updated_at=2023-04-14T00:23:36Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a from target iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a/luns/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a/luns/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a/luns/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a/luns/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a because of JDSS resource v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] delete target: iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] delete target iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a because of JDSS resource iqn.2010-10.org.openstack:d8ec47c6-2ce1-436d-b2d8-0302d688c29a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] deleating volume v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] get snapshots for volume v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] get volume v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433220', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108724', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6166969091186564121', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c09019005ad42128', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321215488', 'san:volume_id': 'c09019005ad4212848aa6d61bde1fac01de8480f', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79183', 'name': 'v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] delete volume:v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] volume v_d8ec47c6-2ce1-436d-b2d8-0302d688c29a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.quota [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Created reservations ['c483a072-629b-425a-9e24-2b1d9a90714b', '8f8e1d1a-aeab-480c-baea-5d1d9e12f6ec', 'f3a63286-c566-496b-b3d5-b09e96f3f956', '17258d5c-bd2f-4dcb-8913-87f3a13daf95'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321297408', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:23:38 user cinder-volume[84560]: DEBUG cinder.manager [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:23:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Deleted volume successfully. Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d8665da1-d5fb-4b94-9542-d491dbc59800 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-d8ec47c6-2ce1-436d-b2d8-0302d688c29a-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Acquiring lock "cinder-0650570a-121d-4d8d-969d-c5c355436eb2-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-0650570a-121d-4d8d-969d-c5c355436eb2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=64,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] remove_export for volume: 0650570a-121d-4d8d-969d-c5c355436eb2. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1058587707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0650570a-121d-4d8d-969d-c5c355436eb2,launched_at=2023-04-14T00:23:31Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth='CHAP QuoXOqAi kzQSAE7F9qfluH',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:29Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:23:39Z,updated_at=2023-04-14T00:23:39Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume v_0650570a-121d-4d8d-969d-c5c355436eb2 from target iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2/luns/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2/luns/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2/luns/v_0650570a-121d-4d8d-969d-c5c355436eb2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2/luns/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 because of JDSS resource v_0650570a-121d-4d8d-969d-c5c355436eb2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] delete target: iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] delete target iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 because of JDSS resource iqn.2010-10.org.openstack:0650570a-121d-4d8d-969d-c5c355436eb2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] deleating volume v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] get snapshots for volume v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] get volume v_0650570a-121d-4d8d-969d-c5c355436eb2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0650570a-121d-4d8d-969d-c5c355436eb2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433220', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108721', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3918232984426173233', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a42f6c84a04438f9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321297408', 'san:volume_id': 'a42f6c84a04438f92732062eda2411e7457c18ce', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79175', 'name': 'v_0650570a-121d-4d8d-969d-c5c355436eb2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] delete volume:v_0650570a-121d-4d8d-969d-c5c355436eb2 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0650570a-121d-4d8d-969d-c5c355436eb2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] volume v_0650570a-121d-4d8d-969d-c5c355436eb2 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.quota [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Created reservations ['5e23935d-5ef1-405c-bf17-9a7260687f6d', '2206aee3-4243-4baa-a977-9954645ff9ef', 'e47fbbdb-449a-441c-889f-994aad5039d9', 'a877bd27-9a81-4f8a-943c-31980cf5e778'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321354752', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.manager [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:23:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Deleted volume successfully. Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c47226ee-c7e7-4783-b791-8ca177289927 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-0650570a-121d-4d8d-969d-c5c355436eb2-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Acquiring lock "cinder-1c1fedaf-d763-493e-8c18-d2b4b4700b76-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-1c1fedaf-d763-493e-8c18-d2b4b4700b76-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] remove_export for volume: 1c1fedaf-d763-493e-8c18-d2b4b4700b76. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1913265352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1c1fedaf-d763-493e-8c18-d2b4b4700b76,launched_at=2023-04-14T00:23:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth='CHAP YyMfQnvZ lwGDmrUnXFEHsJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:29Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:23:43Z,updated_at=2023-04-14T00:23:43Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] detach volume v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 from target iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76/luns/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76/luns/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76/luns/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76/luns/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 because of JDSS resource v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] delete target: iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] delete target iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 because of JDSS resource iqn.2010-10.org.openstack:1c1fedaf-d763-493e-8c18-d2b4b4700b76 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] deleating volume v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] get snapshots for volume v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] get volume v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433219', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108716', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8720520797641972495', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '59414bbd0d4cac59', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321354752', 'san:volume_id': '59414bbd0d4cac598b78a6cad2c492880b1a3406', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80403', 'name': 'v_1c1fedaf-d763-493e-8c18-d2b4b4700b76', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] delete volume:v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] volume v_1c1fedaf-d763-493e-8c18-d2b4b4700b76 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.quota [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Created reservations ['b331d481-ef4b-4fa4-a926-8ed95d37d9e1', '72cbb427-ef14-42b7-94f3-ba522cbac225', '880a6bce-6de2-4076-af8a-437c2e9bb533', '16c2cea1-6c85-4f40-a32b-a8508292ae25'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321412096', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.manager [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:23:45 user cinder-volume[84560]: INFO cinder.volume.manager [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Deleted volume successfully. Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-02249c2e-6b75-4c42-8554-040ddf9ad306 tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-1c1fedaf-d763-493e-8c18-d2b4b4700b76-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Acquiring lock "cinder-e32818c0-6db3-4ab6-91ae-3a1492a560f7-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-e32818c0-6db3-4ab6-91ae-3a1492a560f7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] remove_export for volume: e32818c0-6db3-4ab6-91ae-3a1492a560f7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1923674594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e32818c0-6db3-4ab6-91ae-3a1492a560f7,launched_at=2023-04-14T00:23:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdfc6824a8f4f32907b6a643ca81690',provider_auth='CHAP tUzAPsyT qvVnpHbCrMUePf',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:29Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:23:46Z,updated_at=2023-04-14T00:23:46Z,use_quota=True,user_id='fb2fc1047c944fb2b683591922455010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] detach volume v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 from target iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7/luns/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7/luns/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7/luns/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7/luns/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 because of JDSS resource v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] delete target: iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] delete target iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] failed to remove resource iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 because of JDSS resource iqn.2010-10.org.openstack:e32818c0-6db3-4ab6-91ae-3a1492a560f7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] deleating volume v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] get snapshots for volume v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] get volume v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433219', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108713', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3130311573289788057', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '355b6206109f4810', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321412096', 'san:volume_id': '355b6206109f481039bc65e76f61535e2301dd1e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80395', 'name': 'v_e32818c0-6db3-4ab6-91ae-3a1492a560f7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] delete volume:v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] volume v_e32818c0-6db3-4ab6-91ae-3a1492a560f7 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.quota [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Created reservations ['414483d7-dc03-4ea3-ae30-4ebb7ab49877', 'c758e070-a419-4e46-8438-5f941bfa7180', '9a167ba1-a0e3-4057-b2b5-c908cfc6b28c', '9bc12c1a-2225-4e06-a85c-ce1343cfbd0d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321494016', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.manager [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:23:48 user cinder-volume[84560]: INFO cinder.volume.manager [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Deleted volume successfully. Apr 14 00:23:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-be995a93-2859-43f2-b2c4-1fcba4a9aabe tempest-CreateVolumesFromImageTest-1219950048 None] Lock "cinder-e32818c0-6db3-4ab6-91ae-3a1492a560f7-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Flow 'volume_create_manager' (9d69c018-0083-4857-b08a-a5ddb18ba299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0e6dfd-8099-4365-93a8-5de8fdef5786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc0e6dfd-8099-4365-93a8-5de8fdef5786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=002c82d7-0999-4d39-b4a8-a294a6c77898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2f233e1ed449aa4557ffd6ff1a2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:51Z,use_quota=True,user_id='6c664e94e9bd46eebaf42cc98f5ddc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f22349a-a87d-4ff3-8aab-f534dff2da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f22349a-a87d-4ff3-8aab-f534dff2da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4c5761-0f56-4b8b-8914-7bcb318daada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f4c5761-0f56-4b8b-8914-7bcb318daada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '002c82d7-0999-4d39-b4a8-a294a6c77898', 'volume_name': 'volume-002c82d7-0999-4d39-b4a8-a294a6c77898', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f6584b-5ced-4eb9-b1a6-131151304e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58f6584b-5ced-4eb9-b1a6-131151304e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d41706e-7fd8-4701-8fef-71fa4315fc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Volume 002c82d7-0999-4d39-b4a8-a294a6c77898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-002c82d7-0999-4d39-b4a8-a294a6c77898', 'volume_size': 1} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] creating volume v_002c82d7-0999-4d39-b4a8-a294a6c77898. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] create volume {'name': 'v_002c82d7-0999-4d39-b4a8-a294a6c77898', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_002c82d7-0999-4d39-b4a8-a294a6c77898', 'is_clone': False, 'name': 'v_002c82d7-0999-4d39-b4a8-a294a6c77898'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d41706e-7fd8-4701-8fef-71fa4315fc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-002c82d7-0999-4d39-b4a8-a294a6c77898', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec7440a-98f7-4db5-ba46-64cbe7136718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:51 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Volume volume-002c82d7-0999-4d39-b4a8-a294a6c77898 (002c82d7-0999-4d39-b4a8-a294a6c77898): created successfully Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec7440a-98f7-4db5-ba46-64cbe7136718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:51 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Flow 'volume_create_manager' (9d69c018-0083-4857-b08a-a5ddb18ba299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-bef23ba4-a5e1-408b-8956-b11975bf6c98 tempest-CinderUnicodeTest-1281776480 None] Created volume successfully. Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Flow 'volume_create_manager' (122dbbf4-627b-44a8-aed7-218535c3ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de18b9a-a7bf-42f4-af72-1938d57533bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de18b9a-a7bf-42f4-af72-1938d57533bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-810605875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1e72755e-f918-4435-a316-aebd09795c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2f233e1ed449aa4557ffd6ff1a2c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:23:52Z,use_quota=True,user_id='6c664e94e9bd46eebaf42cc98f5ddc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5fb6d9-68a2-405e-ad79-e12be8c2d861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5fb6d9-68a2-405e-ad79-e12be8c2d861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecaf995-3855-410f-8c22-45d883ce46e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ecaf995-3855-410f-8c22-45d883ce46e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e72755e-f918-4435-a316-aebd09795c24', 'volume_name': 'volume-1e72755e-f918-4435-a316-aebd09795c24', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb17688-864e-45a7-a0a0-7bea69083a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb17688-864e-45a7-a0a0-7bea69083a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14b9cd7-4d00-4e4a-9d60-26a6bca01c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Volume 1e72755e-f918-4435-a316-aebd09795c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e72755e-f918-4435-a316-aebd09795c24', 'volume_size': 1} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] creating volume v_1e72755e-f918-4435-a316-aebd09795c24. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] create volume {'name': 'v_1e72755e-f918-4435-a316-aebd09795c24', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1e72755e-f918-4435-a316-aebd09795c24', 'is_clone': False, 'name': 'v_1e72755e-f918-4435-a316-aebd09795c24'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a14b9cd7-4d00-4e4a-9d60-26a6bca01c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e72755e-f918-4435-a316-aebd09795c24', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267bd508-22a5-4fc9-ace7-6e34e3469392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:23:53 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Volume volume-1e72755e-f918-4435-a316-aebd09795c24 (1e72755e-f918-4435-a316-aebd09795c24): created successfully Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267bd508-22a5-4fc9-ace7-6e34e3469392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Flow 'volume_create_manager' (122dbbf4-627b-44a8-aed7-218535c3ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:23:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e1d8607b-2e22-4270-9432-b070ccae74b3 tempest-CinderUnicodeTest-1281776480 None] Created volume successfully. Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] create snapshot 64c8504b-8b9b-4eed-8bdc-dd9a30b83828 for volume 1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] cloning v_1e72755e-f918-4435-a316-aebd09795c24 to s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] create snapshot s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_64c8504b-8b9b-4eed-8bdc-dd9a30b83828'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] create volume s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 from snapshot s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:23:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1e72755e-f918-4435-a316-aebd09795c24@s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828', 'is_clone': True, 'full_name': 'Pool-0/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828', 'name': 's_64c8504b-8b9b-4eed-8bdc-dd9a30b83828'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] volume s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:23:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-07f60de1-4e57-4adb-a81c-5c9967473349 tempest-CinderUnicodeTest-1281776480 None] Create snapshot completed successfully Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Acquiring lock "cinder-64c8504b-8b9b-4eed-8bdc-dd9a30b83828-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Lock "cinder-64c8504b-8b9b-4eed-8bdc-dd9a30b83828-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] deleating snapshot s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] get snapshots for volume s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] get volume s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1e72755e-f918-4435-a316-aebd09795c24@s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433244', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108748', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14962472075722696917', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e3f50f65ba8cff57', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321281024', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80369', 'name': 's_64c8504b-8b9b-4eed-8bdc-dd9a30b83828', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] delete snapshot s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 of volume v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots/s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] snapshot s_64c8504b-8b9b-4eed-8bdc-dd9a30b83828 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG cinder.quota [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Created reservations ['96d36f3c-982c-408d-8d9b-3f24ffa599bd', 'a04aa498-fdc9-4b8e-bfb0-630ba1ad0a46', 'a0450069-8aba-41dc-892f-31592b13424b', '075253ba-11ab-4d4f-a596-4d2ab100b26d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=59,cinder:DELETE=4,cinder:UPDATE=28,cinder:INSERT=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:INSERT=7,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:23:57 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Delete snapshot completed successfully. Apr 14 00:23:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a997ba9f-0503-45ec-8b65-104c9f535a1b tempest-CinderUnicodeTest-1281776480 None] Lock "cinder-64c8504b-8b9b-4eed-8bdc-dd9a30b83828-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Acquiring lock "cinder-1e72755e-f918-4435-a316-aebd09795c24-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:23:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Lock "cinder-1e72755e-f918-4435-a316-aebd09795c24-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] remove_export for volume: 1e72755e-f918-4435-a316-aebd09795c24. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-810605875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1e72755e-f918-4435-a316-aebd09795c24,launched_at=2023-04-14T00:23:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2f233e1ed449aa4557ffd6ff1a2c4',provider_auth='CHAP CWQGIzvj pGz715LMg8RlKI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:52Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:23:58Z,updated_at=2023-04-14T00:23:58Z,use_quota=True,user_id='6c664e94e9bd46eebaf42cc98f5ddc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] detach volume v_1e72755e-f918-4435-a316-aebd09795c24 from target iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24/luns/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24/luns/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24/luns/v_1e72755e-f918-4435-a316-aebd09795c24'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24/luns/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] failed to remove resource iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 because of JDSS resource v_1e72755e-f918-4435-a316-aebd09795c24 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] delete target: iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] delete target iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] failed to remove resource iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 because of JDSS resource iqn.2010-10.org.openstack:1e72755e-f918-4435-a316-aebd09795c24 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] deleating volume v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] get snapshots for volume v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] get volume v_1e72755e-f918-4435-a316-aebd09795c24 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1e72755e-f918-4435-a316-aebd09795c24', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433242', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108742', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3896163580808828588', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '88b52ea3655331f9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321305600', 'san:volume_id': '88b52ea3655331f9ed1d48b09569277bf7da0e8c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80356', 'name': 'v_1e72755e-f918-4435-a316-aebd09795c24', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] delete volume:v_1e72755e-f918-4435-a316-aebd09795c24 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:23:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e72755e-f918-4435-a316-aebd09795c24 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] volume v_1e72755e-f918-4435-a316-aebd09795c24 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Created reservations ['941491d0-224b-4c59-873c-197927e1f3e7', '298f6b7b-01a3-4c7f-990f-00dcf2f13f71', '0769b2a6-0855-4abb-a8f4-3156e094d29b', 'b2d90a4b-0cbe-4868-9b00-ef7cc57babac'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321387520', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.manager [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:24:00 user cinder-volume[84560]: INFO cinder.volume.manager [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Deleted volume successfully. Apr 14 00:24:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-24fb0648-8006-4153-8472-4a777a8c7992 tempest-CinderUnicodeTest-1281776480 None] Lock "cinder-1e72755e-f918-4435-a316-aebd09795c24-delete_volume" released by "delete_volume" :: held 2.797s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Acquiring lock "cinder-002c82d7-0999-4d39-b4a8-a294a6c77898-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Lock "cinder-002c82d7-0999-4d39-b4a8-a294a6c77898-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] remove_export for volume: 002c82d7-0999-4d39-b4a8-a294a6c77898. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=002c82d7-0999-4d39-b4a8-a294a6c77898,launched_at=2023-04-14T00:23:52Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2f233e1ed449aa4557ffd6ff1a2c4',provider_auth='CHAP EnWHfxai DpgRCFLSEnqi62',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:23:51Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:24:01Z,updated_at=2023-04-14T00:24:01Z,use_quota=True,user_id='6c664e94e9bd46eebaf42cc98f5ddc35',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] detach volume v_002c82d7-0999-4d39-b4a8-a294a6c77898 from target iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898/luns/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898/luns/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898/luns/v_002c82d7-0999-4d39-b4a8-a294a6c77898'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898/luns/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] failed to remove resource iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 because of JDSS resource v_002c82d7-0999-4d39-b4a8-a294a6c77898 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] delete target: iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] delete target iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] failed to remove resource iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 because of JDSS resource iqn.2010-10.org.openstack:002c82d7-0999-4d39-b4a8-a294a6c77898 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] deleating volume v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] get snapshots for volume v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] get volume v_002c82d7-0999-4d39-b4a8-a294a6c77898 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_002c82d7-0999-4d39-b4a8-a294a6c77898', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433241', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108738', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1429000544889296939', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '73ddcd1986845a09', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321387520', 'san:volume_id': '73ddcd1986845a09f8fbc8fb908ec50bf270252c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79815', 'name': 'v_002c82d7-0999-4d39-b4a8-a294a6c77898', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] delete volume:v_002c82d7-0999-4d39-b4a8-a294a6c77898 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_002c82d7-0999-4d39-b4a8-a294a6c77898 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] volume v_002c82d7-0999-4d39-b4a8-a294a6c77898 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.quota [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Created reservations ['a9664e03-e623-41fc-a125-c77631713801', '6ec48372-97e5-4cea-a900-12f5c1911a9c', 'f91196f1-1af4-4dfe-abba-4d4a45bca32d', '8a0a828c-0033-45ce-aa9a-42b5ae22abec'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321469440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:24:04 user cinder-volume[84560]: DEBUG cinder.manager [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:24:04 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Deleted volume successfully. Apr 14 00:24:04 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d27d2103-5dea-42dd-bd9a-868707185b5d tempest-CinderUnicodeTest-1281776480 None] Lock "cinder-002c82d7-0999-4d39-b4a8-a294a6c77898-delete_volume" released by "delete_volume" :: held 2.993s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] terminate connection for 0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:24:12 user cinder-volume[84560]: INFO cinder.volume.manager [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Terminate volume connection completed successfully. Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Deleting attachment a6056597-9848-4805-827e-8c95d7f7332e. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] remove_export for volume: 0c953a4d-d77b-4d17-bcad-ea49b45adbb9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-700982832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0c953a4d-d77b-4d17-bcad-ea49b45adbb9,launched_at=2023-04-14T00:18:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='524265958bd24a6cb94aa3115eb2b6c7',provider_auth='CHAP RxsEKbZB lraTt5cABv3V9s',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:24:11Z,use_quota=True,user_id='f43f3171ccad4167ac783bbdfe2df478',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] detach volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 from target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] delete target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] delete target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f15b1416-6cc9-4e60-b347-6b1e373d4137 req-23355ae0-8eb1-400d-b87d-1fab16536a72 tempest-ServerRescueNegativeTestJSON-1055458768 None] target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:24:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:24:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:24:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:24:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321469440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:24:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=30,cinder:INSERT=4,cinder:UPDATE=15,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=36,cinder:UPDATE=28,cinder:INSERT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] terminate connection for c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:24:32 user cinder-volume[84560]: INFO cinder.volume.manager [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Terminate volume connection completed successfully. Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Deleting attachment c83af900-31a1-488d-a8b4-ff896990a329. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] remove_export for volume: c3cfdf84-a3e1-41e3-85ec-481f5ba478cc. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:44Z,deleted=False,deleted_at=None,display_description='',display_name='17c6c147-fb62-4204-a416-792b94d3f7dd-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=c3cfdf84-a3e1-41e3-85ec-481f5ba478cc,launched_at=2023-04-14T00:08:46Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ba3f111e24414976beddba7ef90c4793',provider_auth='CHAP DXAVYghe hrUaHbmTpAq0nJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:45Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:08:55Z,use_quota=True,user_id='90bad96535c3453792982c5acab9dbc6',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] detach volume v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc from target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/luns/v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/luns/v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc/luns/v_c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] delete target: iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] delete target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:24:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:24:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:24:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a86cae49-5b83-475f-ae05-0473b8ef93fd req-62f71bb0-713e-40d2-b661-3da4f6fdd983 tempest-ServerBootFromVolumeStableRescueTest-1545234843 None] target iqn.2010-10.org.openstack:c3cfdf84-a3e1-41e3-85ec-481f5ba478cc deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:24:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:24:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:25:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:25:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:25:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321469440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:25:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:25:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Acquiring lock "cinder-0c953a4d-d77b-4d17-bcad-ea49b45adbb9-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Lock "cinder-0c953a4d-d77b-4d17-bcad-ea49b45adbb9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] remove_export for volume: 0c953a4d-d77b-4d17-bcad-ea49b45adbb9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-700982832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0c953a4d-d77b-4d17-bcad-ea49b45adbb9,launched_at=2023-04-14T00:18:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524265958bd24a6cb94aa3115eb2b6c7',provider_auth='CHAP RxsEKbZB lraTt5cABv3V9s',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:18:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:25:53Z,updated_at=2023-04-14T00:25:53Z,use_quota=True,user_id='f43f3171ccad4167ac783bbdfe2df478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] detach volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 from target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9/luns/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] failed to remove resource iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 because of JDSS resource v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] delete target: iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] delete target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] failed to remove resource iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 because of JDSS resource iqn.2010-10.org.openstack:0c953a4d-d77b-4d17-bcad-ea49b45adbb9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] deleating volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] get snapshots for volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] get volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432914', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108405', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12675710228411048773', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c49f6a5e03f90ed1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321457152', 'san:volume_id': 'c49f6a5e03f90ed167d9d48a3933e1711f04d186', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79542', 'name': 'v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] delete volume:v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] volume v_0c953a4d-d77b-4d17-bcad-ea49b45adbb9 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.quota [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Created reservations ['906a3102-971d-4232-9dad-7be19f8a1ccd', '9e624221-c507-4d82-a60c-cf91cf9ee1dd', '50b522cc-4afe-4181-af20-90b8fc77ae32', '73b63edc-6742-49ba-bd6b-e22222e3ac60'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321551360', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.manager [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:25:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Deleted volume successfully. Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-11053516-ba58-460a-81d8-7cfd5f93bc0a tempest-ServerRescueNegativeTestJSON-1055458768 None] Lock "cinder-0c953a4d-d77b-4d17-bcad-ea49b45adbb9-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Acquiring lock "cinder-a000737d-73b0-475f-889c-00ea3ff4267e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Lock "cinder-a000737d-73b0-475f-889c-00ea3ff4267e-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] remove_export for volume: a000737d-73b0-475f-889c-00ea3ff4267e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1361506391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=a000737d-73b0-475f-889c-00ea3ff4267e,launched_at=2023-04-14T00:14:41Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='524265958bd24a6cb94aa3115eb2b6c7',provider_auth='CHAP TvaHMWFl 9fM2xdz4CTGaQi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:14:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:25:56Z,updated_at=2023-04-14T00:25:56Z,use_quota=True,user_id='f43f3171ccad4167ac783bbdfe2df478',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] detach volume v_a000737d-73b0-475f-889c-00ea3ff4267e from target iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e/luns/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e/luns/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e/luns/v_a000737d-73b0-475f-889c-00ea3ff4267e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e/luns/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] failed to remove resource iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e because of JDSS resource v_a000737d-73b0-475f-889c-00ea3ff4267e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] delete target: iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] delete target iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] failed to remove resource iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e because of JDSS resource iqn.2010-10.org.openstack:a000737d-73b0-475f-889c-00ea3ff4267e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] deleating volume v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] get snapshots for volume v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] get volume v_a000737d-73b0-475f-889c-00ea3ff4267e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_a000737d-73b0-475f-889c-00ea3ff4267e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432690', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108242', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16575704320648891188', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b3b97966c294587b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321551360', 'san:volume_id': 'b3b97966c294587b75601496351a1761ed8b4c39', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78719', 'name': 'v_a000737d-73b0-475f-889c-00ea3ff4267e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] delete volume:v_a000737d-73b0-475f-889c-00ea3ff4267e recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_a000737d-73b0-475f-889c-00ea3ff4267e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] volume v_a000737d-73b0-475f-889c-00ea3ff4267e deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.quota [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Created reservations ['8b2b21dc-a5fe-4b0f-9081-e963e3399b9a', 'b7d29e85-897f-4d7c-abf0-7df387f58ef8', '1a3cd59a-6392-4a95-9034-31caeb31fcf2', '38c7592c-c258-4b23-9ace-88fc4906d2ed'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321657856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.manager [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:25:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Deleted volume successfully. Apr 14 00:25:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-286b1ee5-5a97-4d7a-9097-ab0e9b12d9ea tempest-ServerRescueNegativeTestJSON-1055458768 None] Lock "cinder-a000737d-73b0-475f-889c-00ea3ff4267e-delete_volume" released by "delete_volume" :: held 3.022s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:26:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=32,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:26:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:26:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:26:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:26:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:26:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321645568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:26:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:26:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (20bb7c22-e4d0-4646-86db-31e652bf8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0059e6bf-50ff-4135-8bcf-9a40c7d08388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0059e6bf-50ff-4135-8bcf-9a40c7d08388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1043397576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=282895bf-6b53-4106-a1e2-abc962b1c521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:26:24Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f90b4c-bf27-46e2-86d6-2177296f8bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f90b4c-bf27-46e2-86d6-2177296f8bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85bb0f7-80a4-4020-98c3-94789103158e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85bb0f7-80a4-4020-98c3-94789103158e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '282895bf-6b53-4106-a1e2-abc962b1c521', 'volume_name': 'volume-282895bf-6b53-4106-a1e2-abc962b1c521', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf8112d-a172-4ddc-aba0-09713681c840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf8112d-a172-4ddc-aba0-09713681c840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5076910e-b689-4f70-bdfc-4bac24aa748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:23 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Volume 282895bf-6b53-4106-a1e2-abc962b1c521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-282895bf-6b53-4106-a1e2-abc962b1c521', 'volume_size': 1} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] creating volume v_282895bf-6b53-4106-a1e2-abc962b1c521. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] create volume {'name': 'v_282895bf-6b53-4106-a1e2-abc962b1c521', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:26:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:26:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521', 'is_clone': False, 'name': 'v_282895bf-6b53-4106-a1e2-abc962b1c521'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:26:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5076910e-b689-4f70-bdfc-4bac24aa748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-282895bf-6b53-4106-a1e2-abc962b1c521', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523ed35f-1530-4452-8261-d7b2995e82e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Volume volume-282895bf-6b53-4106-a1e2-abc962b1c521 (282895bf-6b53-4106-a1e2-abc962b1c521): created successfully Apr 14 00:26:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523ed35f-1530-4452-8261-d7b2995e82e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (20bb7c22-e4d0-4646-86db-31e652bf8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:26:24 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fc92e71d-8867-4c28-a35a-e83d1c6ce63a tempest-VolumesSnapshotTestJSON-655184435 None] Created volume successfully. Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (1748a52e-65d6-40b9-b87f-5e36b9f25e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3785c7a2-c3a7-4132-964c-1c1fc9088f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3785c7a2-c3a7-4132-964c-1c1fc9088f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1368023957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=62c40b52-a5d3-47d1-8a30-d50aa4514387,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:26:26Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a3d5db-07c2-46c5-a711-a9e37cdb0b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a3d5db-07c2-46c5-a711-a9e37cdb0b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33dbdd7-a798-4c08-b2ce-9c06add90268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33dbdd7-a798-4c08-b2ce-9c06add90268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '62c40b52-a5d3-47d1-8a30-d50aa4514387', 'volume_name': 'volume-62c40b52-a5d3-47d1-8a30-d50aa4514387', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c211e37-7cdb-4120-bf47-914b9028f458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c211e37-7cdb-4120-bf47-914b9028f458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eb226c-bff5-4793-85d1-68cc4bc9b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Volume 62c40b52-a5d3-47d1-8a30-d50aa4514387: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-62c40b52-a5d3-47d1-8a30-d50aa4514387', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Cloning 62c40b52-a5d3-47d1-8a30-d50aa4514387 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.coordination [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.coordination [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 26, 26, 529498)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.coordination [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 26, 26, 543038)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:26:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:26:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_62c40b52-a5d3-47d1-8a30-d50aa4514387'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:26:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] create volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 from snapshot v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:26:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:26:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'is_clone': True, 'full_name': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'name': 'v_62c40b52-a5d3-47d1-8a30-d50aa4514387'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433397', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108793', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4421811066750252528', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ecef743a335ba184', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321514496', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78947', 'name': 'v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Marking volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 62c40b52-a5d3-47d1-8a30-d50aa4514387. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Creating volume glance metadata for volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80eb226c-bff5-4793-85d1-68cc4bc9b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c40b52-a5d3-47d1-8a30-d50aa4514387', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b471b131-7513-499f-9b4b-12c58c7ded59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:26:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Volume volume-62c40b52-a5d3-47d1-8a30-d50aa4514387 (62c40b52-a5d3-47d1-8a30-d50aa4514387): created successfully Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b471b131-7513-499f-9b4b-12c58c7ded59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:26:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (1748a52e-65d6-40b9-b87f-5e36b9f25e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:26:28 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7df620b9-2e61-4797-bf30-b8055619c4af tempest-VolumesSnapshotTestJSON-655184435 None] Created volume successfully. Apr 14 00:26:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=25,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:26:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=25,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321526784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:27:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:27:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:27:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] terminate connection for 7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:28:04 user cinder-volume[84560]: INFO cinder.volume.manager [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Terminate volume connection completed successfully. Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Deleting attachment bdc31db9-2b5e-49a1-88c3-b26415140a22. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-281846307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7056196a-d087-4a9b-a3c8-350b13e6d2c3,launched_at=2023-04-14T00:21:26Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP BcLTtdGe O3jcCRVaTHgipz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:21:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:23:35Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] detach volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 from target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-06e0f21e-7ba3-42e1-85a4-328d6ed90191 tempest-ServerActionsTestJSON-948553482 None] target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.coordination [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Acquiring lock "cinder-7056196a-d087-4a9b-a3c8-350b13e6d2c3-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.coordination [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-7056196a-d087-4a9b-a3c8-350b13e6d2c3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-281846307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=7056196a-d087-4a9b-a3c8-350b13e6d2c3,launched_at=2023-04-14T00:21:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP BcLTtdGe O3jcCRVaTHgipz',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:21:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:28:05Z,updated_at=2023-04-14T00:28:05Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] detach volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 from target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3/luns/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] failed to remove resource iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 because of JDSS resource v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] failed to remove resource iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 because of JDSS resource iqn.2010-10.org.openstack:7056196a-d087-4a9b-a3c8-350b13e6d2c3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] deleating volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] get snapshots for volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] get volume v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433095', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26112000', 'sharesmb': None, 'createtxg': '108651', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10292363128037065970', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10133504', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': 'd6ae34e51c0cba65', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321539072', 'san:volume_id': 'd6ae34e51c0cba658a72db39bdf1d7f7c87c30bf', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10133504', 'objsetid': '80138', 'name': 'v_7056196a-d087-4a9b-a3c8-350b13e6d2c3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10133504', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] delete snapshot v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] snapshot v_7056196a-d087-4a9b-a3c8-350b13e6d2c3 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.quota [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Created reservations ['c734f5e6-b66e-42b1-a344-5c4ed23a47ae', '5007a800-849e-4271-a13c-b47f3e73d492', 'd63aa408-962c-421e-b532-c25b6501eb85', 'da5e3014-caad-4857-b780-294d25aedd19'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331734016', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:28:07 user cinder-volume[84560]: DEBUG cinder.manager [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:28:07 user cinder-volume[84560]: INFO cinder.volume.manager [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Deleted volume successfully. Apr 14 00:28:07 user cinder-volume[84560]: DEBUG cinder.coordination [req-601710f8-4449-4ec5-af12-e92a871fb83c req-a91b8589-3357-405b-abf9-073eea627d93 tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-7056196a-d087-4a9b-a3c8-350b13e6d2c3-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] create export for volume: 62c40b52-a5d3-47d1-8a30-d50aa4514387. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] ensure volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] check if targe iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] create target and attach volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] create target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331734016', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:28:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:28:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] atach volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 to target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:28:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6563656637343361', 'lun': 0, 'mode': 'wt', 'name': 'v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'prod_id': 'Storage', 'scsi_id': 'ecef743a335ba184'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] add credentails to target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'name': 'zOgGiwXu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] initialize_connection for 62c40b52-a5d3-47d1-8a30-d50aa4514387 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:28:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zOgGiwXu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'a5f482b2-b1bf-4452-83be-204a058ad5c3'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:28:25 user cinder-volume[84560]: INFO cinder.volume.manager [req-21d0a551-d1ed-4d35-9ab6-2ae960f1e86a req-23c4fc1e-6485-42de-8685-406006b4b8b2 tempest-VolumesSnapshotTestJSON-655184435 None] attachment_update completed successfully. Apr 14 00:28:27 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=33,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot ec25b4cb-bffa-4558-a143-aca3bfe6d926 for volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:28:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_62c40b52-a5d3-47d1-8a30-d50aa4514387 to s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:28:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:28:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_ec25b4cb-bffa-4558-a143-aca3bfe6d926'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 from snapshot s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:28:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387@s_ec25b4cb-bffa-4558-a143-aca3bfe6d926', 'is_clone': True, 'full_name': 'Pool-0/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926', 'name': 's_ec25b4cb-bffa-4558-a143-aca3bfe6d926'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:28:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-94d9b857-b523-459f-9852-1e7c95242cd4 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:28:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 19588441-3e4e-495c-b5c3-7676065113fd for volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:28:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_62c40b52-a5d3-47d1-8a30-d50aa4514387 to s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:28:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:28:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_19588441-3e4e-495c-b5c3-7676065113fd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_19588441-3e4e-495c-b5c3-7676065113fd from snapshot s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387@s_19588441-3e4e-495c-b5c3-7676065113fd', 'is_clone': True, 'full_name': 'Pool-0/s_19588441-3e4e-495c-b5c3-7676065113fd', 'name': 's_19588441-3e4e-495c-b5c3-7676065113fd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_19588441-3e4e-495c-b5c3-7676065113fd properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:28:32 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d6b46e1d-7f48-4076-9ba3-faf7c1f16404 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:28:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 911ab01d-084a-491f-bb3d-f39546307261 for volume 62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:28:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_62c40b52-a5d3-47d1-8a30-d50aa4514387 to s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:28:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:28:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_911ab01d-084a-491f-bb3d-f39546307261'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_911ab01d-084a-491f-bb3d-f39546307261 from snapshot s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:28:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387@s_911ab01d-084a-491f-bb3d-f39546307261', 'is_clone': True, 'full_name': 'Pool-0/s_911ab01d-084a-491f-bb3d-f39546307261', 'name': 's_911ab01d-084a-491f-bb3d-f39546307261'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_911ab01d-084a-491f-bb3d-f39546307261 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=38,cinder:INSERT=15,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:35 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a3a3b8f3-2020-46ec-8ce8-7ad71015fdb6 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-ec25b4cb-bffa-4558-a143-aca3bfe6d926-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-ec25b4cb-bffa-4558-a143-aca3bfe6d926-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_ec25b4cb-bffa-4558-a143-aca3bfe6d926. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387@s_ec25b4cb-bffa-4558-a143-aca3bfe6d926', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433518', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108830', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5710351019039475548', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '67c1eb3a48e647b2', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331635712', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79208', 'name': 's_ec25b4cb-bffa-4558-a143-aca3bfe6d926', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 of volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_ec25b4cb-bffa-4558-a143-aca3bfe6d926 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.quota [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['80e59116-e376-47ca-8ab5-17f109e5b8bc', 'ab0c65a5-0e8b-4b1f-afb3-907b711d33b3', '4781380e-4918-4f01-be0a-474e24632c85', 'bf4fd0ce-81e0-4602-8141-5d3612101be0'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:28:37 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b66626cb-1971-4775-a31e-c00e4f40622b tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-ec25b4cb-bffa-4558-a143-aca3bfe6d926-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-911ab01d-084a-491f-bb3d-f39546307261-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-911ab01d-084a-491f-bb3d-f39546307261-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_911ab01d-084a-491f-bb3d-f39546307261. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_911ab01d-084a-491f-bb3d-f39546307261 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387@s_911ab01d-084a-491f-bb3d-f39546307261', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_911ab01d-084a-491f-bb3d-f39546307261', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433524', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108842', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '781046775596793211', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '96a67e038296641f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331684864', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78314', 'name': 's_911ab01d-084a-491f-bb3d-f39546307261', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_911ab01d-084a-491f-bb3d-f39546307261 of volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_911ab01d-084a-491f-bb3d-f39546307261 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_911ab01d-084a-491f-bb3d-f39546307261 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.quota [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['1eba9bc9-9af1-49db-9b76-c93e06f42c6f', 'ce9f301c-a66c-40e2-97be-20e991fbd174', 'a3a8d519-75bf-4ad9-accd-5c9e504b595a', 'ea406a10-542f-4a8b-9c4e-bc9e3665680d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:28:39 user cinder-volume[84560]: INFO cinder.volume.manager [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-23811628-12bc-4398-9d34-b178c11f522a tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-911ab01d-084a-491f-bb3d-f39546307261-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-19588441-3e4e-495c-b5c3-7676065113fd-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.coordination [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-19588441-3e4e-495c-b5c3-7676065113fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_19588441-3e4e-495c-b5c3-7676065113fd. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_19588441-3e4e-495c-b5c3-7676065113fd info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387@s_19588441-3e4e-495c-b5c3-7676065113fd', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_19588441-3e4e-495c-b5c3-7676065113fd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433521', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108836', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18332976859892213000', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0da978a9925ab50f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331709440', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79224', 'name': 's_19588441-3e4e-495c-b5c3-7676065113fd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_19588441-3e4e-495c-b5c3-7676065113fd of volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots/s_19588441-3e4e-495c-b5c3-7676065113fd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_19588441-3e4e-495c-b5c3-7676065113fd deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:28:41 user cinder-volume[84560]: DEBUG cinder.quota [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['b95def31-94c4-4975-ad71-765285b7fe83', 'dd3c5a7f-6879-4a9b-9181-f7daeb1ec58f', 'ad1d4fe2-01ed-475f-87cb-70284ee0c824', 'cffb7b3e-bc82-4516-a271-3a3ceb73eaa8'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:28:41 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=50,cinder:INSERT=31,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:28:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:28:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-edb0d163-dc9f-4368-abb9-1d5fe93557d5 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-19588441-3e4e-495c-b5c3-7676065113fd-delete_snapshot" released by "delete_snapshot" :: held 1.993s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] terminate connection for 62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:28:43 user cinder-volume[84560]: INFO cinder.volume.manager [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Terminate volume connection completed successfully. Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Deleting attachment a5f482b2-b1bf-4452-83be-204a058ad5c3. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 62c40b52-a5d3-47d1-8a30-d50aa4514387. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1368023957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=62c40b52-a5d3-47d1-8a30-d50aa4514387,launched_at=2023-04-14T00:26:29Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP zOgGiwXu OdpjtcqWQzJbD2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:26:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:28:42Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 from target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:28:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-022d811c-442a-4d54-a74d-01cd4881745d req-1296bf7a-880c-4448-83b0-5865e2dfb0a5 tempest-VolumesSnapshotTestJSON-655184435 None] target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:28:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=21,cinder:DELETE=1,cinder:SELECT=38,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:32 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-62c40b52-a5d3-47d1-8a30-d50aa4514387-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-62c40b52-a5d3-47d1-8a30-d50aa4514387-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 62c40b52-a5d3-47d1-8a30-d50aa4514387. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1368023957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=62c40b52-a5d3-47d1-8a30-d50aa4514387,launched_at=2023-04-14T00:26:29Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP zOgGiwXu OdpjtcqWQzJbD2',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:26:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:29:33Z,updated_at=2023-04-14T00:29:33Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 from target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387/luns/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 because of JDSS resource v_62c40b52-a5d3-47d1-8a30-d50aa4514387 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 because of JDSS resource iqn.2010-10.org.openstack:62c40b52-a5d3-47d1-8a30-d50aa4514387 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] deleating volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_62c40b52-a5d3-47d1-8a30-d50aa4514387 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433397', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '108793', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4421811066750252528', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ecef743a335ba184', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331721728', 'san:volume_id': 'ecef743a335ba18487e3cbc744233526cf307ab8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78947', 'name': 'v_62c40b52-a5d3-47d1-8a30-d50aa4514387', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot v_62c40b52-a5d3-47d1-8a30-d50aa4514387 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_62c40b52-a5d3-47d1-8a30-d50aa4514387 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] snapshot v_62c40b52-a5d3-47d1-8a30-d50aa4514387 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.quota [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['d95fc026-a9c9-4e07-a584-df98ebf22315', '81061a7f-dd0d-4374-b749-7f17c63d8152', '98262365-f265-4dc1-bb71-88ca33613019', '6eb24bb8-034d-47fa-b07d-244738c6d4fd'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331770880', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.manager [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:29:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Deleted volume successfully. Apr 14 00:29:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f312b6c9-df25-4ed4-a836-b248e7a7af84 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-62c40b52-a5d3-47d1-8a30-d50aa4514387-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 842ab4c8-e9e8-4dec-85d4-67b4049e7f5b for volume 282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_282895bf-6b53-4106-a1e2-abc962b1c521 to s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b from snapshot s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:29:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b', 'is_clone': True, 'full_name': 'Pool-0/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b', 'name': 's_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:29:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7419a426-2451-41f6-92d6-a424a2a82896 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-842ab4c8-e9e8-4dec-85d4-67b4049e7f5b-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-842ab4c8-e9e8-4dec-85d4-67b4049e7f5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433587', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108873', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12517345509638196495', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b43620fe271b0974', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331746304', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79561', 'name': 's_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b of volume v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_842ab4c8-e9e8-4dec-85d4-67b4049e7f5b deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.quota [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['8769a06a-6b06-46b6-a30f-aa87fdc62c2b', 'c0b41dae-18d8-4602-80d9-a5f1591883ac', '95cf00b8-9dcf-45fc-bbdf-3a3e08c6d46b', '98feada3-0f9d-40e5-be8d-b3e5d712457d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:29:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26c03f9a-bff7-460e-b1c3-0574650e1ce0 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-842ab4c8-e9e8-4dec-85d4-67b4049e7f5b-delete_snapshot" released by "delete_snapshot" :: held 2.002s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 412462dc-00f2-4af9-b335-da6848c66dbd for volume 282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_282895bf-6b53-4106-a1e2-abc962b1c521 to s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_412462dc-00f2-4af9-b335-da6848c66dbd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_412462dc-00f2-4af9-b335-da6848c66dbd from snapshot s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_412462dc-00f2-4af9-b335-da6848c66dbd', 'is_clone': True, 'full_name': 'Pool-0/s_412462dc-00f2-4af9-b335-da6848c66dbd', 'name': 's_412462dc-00f2-4af9-b335-da6848c66dbd'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_412462dc-00f2-4af9-b335-da6848c66dbd properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:29:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-013fe218-7895-4247-82fd-3df8bb5f26e0 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Acquiring lock "cinder-94d1d134-5857-4a7c-bf52-bd818e828f3e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-94d1d134-5857-4a7c-bf52-bd818e828f3e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-1167118353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=94d1d134-5857-4a7c-bf52-bd818e828f3e,launched_at=2023-04-14T00:13:48Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP YrRJCHcL Iao2OgXFZDwCrm',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:13:47Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:29:43Z,updated_at=2023-04-14T00:29:43Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] detach volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e from target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e/luns/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] failed to remove resource iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e because of JDSS resource v_94d1d134-5857-4a7c-bf52-bd818e828f3e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] failed to remove resource iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e because of JDSS resource iqn.2010-10.org.openstack:94d1d134-5857-4a7c-bf52-bd818e828f3e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] deleating volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] get snapshots for volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] get volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432637', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108216', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10932104229507146926', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3c4739dd0c0e6c33', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331746304', 'san:volume_id': '3c4739dd0c0e6c332ddf6fbe0fc63d78c84b99e2', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78541', 'name': 'v_94d1d134-5857-4a7c-bf52-bd818e828f3e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] delete volume:v_94d1d134-5857-4a7c-bf52-bd818e828f3e recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_94d1d134-5857-4a7c-bf52-bd818e828f3e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] volume v_94d1d134-5857-4a7c-bf52-bd818e828f3e deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:29:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=32,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:29:45 user cinder-volume[84560]: DEBUG cinder.quota [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Created reservations ['f287fead-5758-4e7b-8263-678a6ef3a5eb', 'abf70022-4a40-43e2-9f93-48f268772f7a', '6a544b0c-b515-4f9e-839a-2f3426a57ba6', 'f7ae2fa0-0368-46cd-8703-5b2c5015aa4a'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Acquiring lock "cinder-49172d5a-2944-486a-a080-04548e55ac0d-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-49172d5a-2944-486a-a080-04548e55ac0d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] remove_export for volume: 49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:08:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-427589178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=49172d5a-2944-486a-a080-04548e55ac0d,launched_at=2023-04-14T00:08:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf8663ccad9047f4b11b9ae0646c287a',provider_auth='CHAP mpSjLhaD kHcvwSOuQGKYJI',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:08:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:29:46Z,updated_at=2023-04-14T00:29:46Z,use_quota=True,user_id='3d86662f2c7648daad87118b7e9f757c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] detach volume v_49172d5a-2944-486a-a080-04548e55ac0d from target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331852800', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.manager [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:29:46 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Deleted volume successfully. Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2cc58ea7-3f85-4619-9fb4-f045937c7712 tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-94d1d134-5857-4a7c-bf52-bd818e828f3e-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d/luns/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] failed to remove resource iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d because of JDSS resource v_49172d5a-2944-486a-a080-04548e55ac0d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] delete target: iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] delete target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] failed to remove resource iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d because of JDSS resource iqn.2010-10.org.openstack:49172d5a-2944-486a-a080-04548e55ac0d DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] deleating volume v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] get snapshots for volume v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] get volume v_49172d5a-2944-486a-a080-04548e55ac0d info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_49172d5a-2944-486a-a080-04548e55ac0d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681432339', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108012', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13848124019497466106', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '754ce9dd2476b9b3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331852800', 'san:volume_id': '754ce9dd2476b9b386ce52bc0419ec3d8df4ecdb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78771', 'name': 'v_49172d5a-2944-486a-a080-04548e55ac0d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] delete volume:v_49172d5a-2944-486a-a080-04548e55ac0d recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_49172d5a-2944-486a-a080-04548e55ac0d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] volume v_49172d5a-2944-486a-a080-04548e55ac0d deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.quota [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Created reservations ['2ad65ce6-d2f9-4935-941a-062f761145cc', 'c8f8b4f6-942d-4559-9fc5-981ca4d8194a', '5d0f73f0-1492-45a6-a7af-f52bc91d36eb', '63555c7e-dd12-4641-ad15-d08ada8275a1'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331922432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.manager [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:29:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Deleted volume successfully. Apr 14 00:29:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-84d4993f-6ac7-449a-9cb7-39bb81a9219b tempest-ServerActionsTestJSON-948553482 None] Lock "cinder-49172d5a-2944-486a-a080-04548e55ac0d-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Flow 'volume_create_manager' (cd91cb9f-97b0-483e-b8be-8ce5042feb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0dd056-5d55-4a5e-8281-f623544d240f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0dd056-5d55-4a5e-8281-f623544d240f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-600047236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e6d8bdbf-1181-4c21-b159-ed5bdcf94d28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='532754441b5b4e29b19b4b877208674f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:29:56Z,use_quota=True,user_id='b908cd904b7f4f298cc4c8f1afe0b454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c8b115-4d6b-402b-8efc-aa6c1c77fe7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c8b115-4d6b-402b-8efc-aa6c1c77fe7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce06442-77cd-4423-a0a9-6ba23f54b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce06442-77cd-4423-a0a9-6ba23f54b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'volume_name': 'volume-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eefcfb7-716f-4923-9ecf-557c7dba2504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eefcfb7-716f-4923-9ecf-557c7dba2504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe47bb11-3b07-4229-a10b-1b89af1da2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:29:55 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Volume e6d8bdbf-1181-4c21-b159-ed5bdcf94d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'volume_size': 1} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] creating volume v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] create volume {'name': 'v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'is_clone': False, 'name': 'v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe47bb11-3b07-4229-a10b-1b89af1da2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:29:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc3b5c0-8433-4080-a88e-907067607f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:29:56 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Volume volume-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 (e6d8bdbf-1181-4c21-b159-ed5bdcf94d28): created successfully Apr 14 00:29:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edc3b5c0-8433-4080-a88e-907067607f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:29:56 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Flow 'volume_create_manager' (cd91cb9f-97b0-483e-b8be-8ce5042feb6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:29:56 user cinder-volume[84560]: INFO cinder.volume.manager [req-c986f966-75c5-4bb5-a95d-2f1031040c41 req-54199987-e1da-4bb3-9be4-dd580ce7fe07 tempest-VolumesGetTestJSON-1055780600 None] Created volume successfully. Apr 14 00:29:56 user cinder-volume[84560]: DEBUG cinder.coordination [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Acquiring lock "cinder-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.coordination [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Lock "cinder-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] remove_export for volume: e6d8bdbf-1181-4c21-b159-ed5bdcf94d28. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:29:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-600047236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e6d8bdbf-1181-4c21-b159-ed5bdcf94d28,launched_at=2023-04-14T00:29:57Z,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='532754441b5b4e29b19b4b877208674f',provider_auth='CHAP FsXeykoi OXUFpnQ81lbRSk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:29:56Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:29:57Z,updated_at=2023-04-14T00:29:57Z,use_quota=True,user_id='b908cd904b7f4f298cc4c8f1afe0b454',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] detach volume v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 from target iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/luns/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/luns/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/luns/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/luns/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] failed to remove resource iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 because of JDSS resource v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] delete target: iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] delete target iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] failed to remove resource iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 because of JDSS resource iqn.2010-10.org.openstack:e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] deleating volume v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] get snapshots for volume v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] get volume v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433605', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108890', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3086386712017566875', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0e0c0663ca2b7391', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331852800', 'san:volume_id': '0e0c0663ca2b7391d766c2ee12b3a8444e801fe0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79826', 'name': 'v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] delete volume:v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] volume v_e6d8bdbf-1181-4c21-b159-ed5bdcf94d28 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.quota [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Created reservations ['bbf18c6f-e94c-4055-bc79-fa6664982242', '99b6f318-0050-4b55-ba8d-21214d4fc747', '812905bf-4add-4091-9d91-f0b87934a1b9', 'c797affe-5cf7-4bd1-8359-4054693ef513'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331934720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.manager [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:29:59 user cinder-volume[84560]: INFO cinder.volume.manager [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Deleted volume successfully. Apr 14 00:29:59 user cinder-volume[84560]: DEBUG cinder.coordination [req-a0e4305f-915d-4f15-b104-9d67ce655f88 req-5b584009-f800-4419-b1db-9919755aba3b tempest-VolumesGetTestJSON-1055780600 None] Lock "cinder-e6d8bdbf-1181-4c21-b159-ed5bdcf94d28-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=65,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Flow 'volume_create_manager' (bf72cc27-1958-4257-91fe-2b2f2d40f5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24def078-c619-4b76-aa2b-04fecd9d46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24def078-c619-4b76-aa2b-04fecd9d46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1589657964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f8185b1c-ac4a-4b99-a97c-b9873ff8898b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdeb0cdc283a42eba2bc6636e36578bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:30:03Z,use_quota=True,user_id='150420c90d5943baaffa8f3c802e457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a45ebbdf-e8f9-4e1d-a4b2-234462ffca04),volume_type_id=a45ebbdf-e8f9-4e1d-a4b2-234462ffca04)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202a623b-afbd-4d5d-bd27-872c80574a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202a623b-afbd-4d5d-bd27-872c80574a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4b940d-c9dd-45fa-8464-15899e513458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e4b940d-c9dd-45fa-8464-15899e513458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'volume_name': 'volume-f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dea3b9b-31cf-4dda-92b5-1d8e598f2a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dea3b9b-31cf-4dda-92b5-1d8e598f2a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723fbe70-b604-489d-b32c-c90ce7638497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:03 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Volume f8185b1c-ac4a-4b99-a97c-b9873ff8898b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'volume_size': 1} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] creating volume v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] create volume {'name': 'v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'is_clone': False, 'name': 'v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723fbe70-b604-489d-b32c-c90ce7638497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28f9d96-9093-4c12-a1b2-a3cbc3012db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:03 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Volume volume-f8185b1c-ac4a-4b99-a97c-b9873ff8898b (f8185b1c-ac4a-4b99-a97c-b9873ff8898b): created successfully Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28f9d96-9093-4c12-a1b2-a3cbc3012db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Flow 'volume_create_manager' (bf72cc27-1958-4257-91fe-2b2f2d40f5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:30:03 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e7027acb-bb1e-4579-8a42-b66892ef1e16 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Created volume successfully. Apr 14 00:30:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=50,cinder:INSERT=8,cinder:UPDATE=40,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:30:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:30:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331828224', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.manager [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:30:06 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2f26cc2e-9d63-49ae-a4bf-2caf89bdca5b tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Retype volume completed successfully. Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Acquiring lock "cinder-f8185b1c-ac4a-4b99-a97c-b9873ff8898b-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.coordination [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Lock "cinder-f8185b1c-ac4a-4b99-a97c-b9873ff8898b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] remove_export for volume: f8185b1c-ac4a-4b99-a97c-b9873ff8898b. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1589657964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f8185b1c-ac4a-4b99-a97c-b9873ff8898b,launched_at=2023-04-14T00:30:04Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='fdeb0cdc283a42eba2bc6636e36578bd',provider_auth='CHAP cymdqUxv TLQF0Gx2EiVByb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:30:03Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:30:07Z,updated_at=2023-04-14T00:30:07Z,use_quota=True,user_id='150420c90d5943baaffa8f3c802e457b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a9868a57-a910-4f31-afbf-188f31cf7650),volume_type_id=a9868a57-a910-4f31-afbf-188f31cf7650) from target:iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] detach volume v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b from target iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b/luns/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b/luns/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b/luns/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b/luns/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] failed to remove resource iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b because of JDSS resource v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] delete target: iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] delete target iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] failed to remove resource iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b because of JDSS resource iqn.2010-10.org.openstack:f8185b1c-ac4a-4b99-a97c-b9873ff8898b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] deleating volume v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] get snapshots for volume v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] get volume v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433613', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108895', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4683345727351502502', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b11d7877d5f40524', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331828224', 'san:volume_id': 'b11d7877d5f4052458755554e162ef6854a5692b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '79837', 'name': 'v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] delete volume:v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] volume v_f8185b1c-ac4a-4b99-a97c-b9873ff8898b deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:30:08 user cinder-volume[84560]: WARNING cinder.quota [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:30:08 user cinder-volume[84560]: WARNING cinder.quota [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.quota [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Created reservations ['670e2b69-83b1-47dd-be57-2bd70a058706', '12abb373-e346-4142-ab3e-84f427e8ddd9', '93d2bbd0-bd44-4a3c-baf7-4c7de5ba973f', 'dd670ca0-7304-4ad6-b846-2c9c4393c9ca'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331910144', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:30:09 user cinder-volume[84560]: DEBUG cinder.manager [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:30:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Deleted volume successfully. Apr 14 00:30:09 user cinder-volume[84560]: DEBUG cinder.coordination [None req-101c998f-b21d-492b-a185-9ff91b7dc2e7 tempest-VolumeRetypeWithoutMigrationTest-1557990856 None] Lock "cinder-f8185b1c-ac4a-4b99-a97c-b9873ff8898b-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Flow 'volume_create_manager' (c24e5c09-9a6b-41f4-b833-8235eaf8bf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11989914-1991-4968-b629-108b71288a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11989914-1991-4968-b629-108b71288a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1691758439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6ba9d78c-ee98-4a54-9e86-f00163e8e3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee0ef1c7b2648ffbe3adeed1720f657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:30:13Z,use_quota=True,user_id='ca44608a78a24f3eabd38e818d75ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fb1330-fba3-4651-adfb-e7d98bc9767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fb1330-fba3-4651-adfb-e7d98bc9767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d8a0f8-e18d-4e8b-98d1-fe691feaad62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d8a0f8-e18d-4e8b-98d1-fe691feaad62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'volume_name': 'volume-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a35519-f3ce-4e92-91ec-86e714b5ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38a35519-f3ce-4e92-91ec-86e714b5ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415c52a1-d06f-4929-9cf1-10781a98ad8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:13 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Volume 6ba9d78c-ee98-4a54-9e86-f00163e8e3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'volume_size': 1} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] creating volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] create volume {'name': 'v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'is_clone': False, 'name': 'v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415c52a1-d06f-4929-9cf1-10781a98ad8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6026a9-1b64-41d7-b068-db5672ff3831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:13 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Volume volume-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 (6ba9d78c-ee98-4a54-9e86-f00163e8e3d7): created successfully Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e6026a9-1b64-41d7-b068-db5672ff3831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:13 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Flow 'volume_create_manager' (c24e5c09-9a6b-41f4-b833-8235eaf8bf1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:30:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-abf0a386-7fa6-4f67-b195-42eb282e9f47 tempest-SnapshotMetadataTestJSON-2058312433 None] Created volume successfully. Apr 14 00:30:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] create snapshot 717062a0-374c-4da6-9665-df95ded11274 for volume 6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:30:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] cloning v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 to s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:30:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] create snapshot s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:30:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_717062a0-374c-4da6-9665-df95ded11274'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] create volume s_717062a0-374c-4da6-9665-df95ded11274 from snapshot s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7@s_717062a0-374c-4da6-9665-df95ded11274', 'is_clone': True, 'full_name': 'Pool-0/s_717062a0-374c-4da6-9665-df95ded11274', 'name': 's_717062a0-374c-4da6-9665-df95ded11274'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] volume s_717062a0-374c-4da6-9665-df95ded11274 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:30:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8f710059-1cb6-4ba4-9ec8-6a0efc1f7cc2 tempest-SnapshotMetadataTestJSON-2058312433 None] Create snapshot completed successfully Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Acquiring lock "cinder-717062a0-374c-4da6-9665-df95ded11274-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Lock "cinder-717062a0-374c-4da6-9665-df95ded11274-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] deleating snapshot s_717062a0-374c-4da6-9665-df95ded11274. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] get snapshots for volume s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] get volume s_717062a0-374c-4da6-9665-df95ded11274 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7@s_717062a0-374c-4da6-9665-df95ded11274', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_717062a0-374c-4da6-9665-df95ded11274', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433624', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108907', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9757927492257614072', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bee194fc9fffccbc', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331803648', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80669', 'name': 's_717062a0-374c-4da6-9665-df95ded11274', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] delete snapshot s_717062a0-374c-4da6-9665-df95ded11274 of volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots/s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots/s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots/s_717062a0-374c-4da6-9665-df95ded11274 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] snapshot s_717062a0-374c-4da6-9665-df95ded11274 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.quota [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Created reservations ['cccc83bd-6f04-484b-bad1-c9f696a457b8', 'ef0b1583-8d88-4aef-a733-fe917231f088', 'debd4360-95e3-4c5d-ab07-f4edf4e3838f', 'dedc05f0-dcd6-4cf2-bd2b-c10ad943e770'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:30:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Delete snapshot completed successfully. Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8b05daf4-e917-4817-9a8d-5e679b139e71 tempest-SnapshotMetadataTestJSON-2058312433 None] Lock "cinder-717062a0-374c-4da6-9665-df95ded11274-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Acquiring lock "cinder-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Lock "cinder-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] remove_export for volume: 6ba9d78c-ee98-4a54-9e86-f00163e8e3d7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1691758439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6ba9d78c-ee98-4a54-9e86-f00163e8e3d7,launched_at=2023-04-14T00:30:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee0ef1c7b2648ffbe3adeed1720f657',provider_auth='CHAP xbqaLOkt cx4Y2XsbCQuh5y',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:30:13Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:30:19Z,updated_at=2023-04-14T00:30:19Z,use_quota=True,user_id='ca44608a78a24f3eabd38e818d75ea0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] detach volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 from target iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/luns/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/luns/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/luns/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/luns/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] failed to remove resource iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 because of JDSS resource v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] delete target: iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] delete target iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] failed to remove resource iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 because of JDSS resource iqn.2010-10.org.openstack:6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] deleating volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] get snapshots for volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] get volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433623', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108901', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7708475476350012590', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'e13d9c007511dee1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331840512', 'san:volume_id': 'e13d9c007511dee1ffe1b779b07a7579de088995', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80656', 'name': 'v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] delete volume:v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] volume v_6ba9d78c-ee98-4a54-9e86-f00163e8e3d7 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.quota [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Created reservations ['aed3db31-4cd9-4c43-b60d-2d2640387d1c', 'f301a21c-2e2e-4b5f-a528-2457f3153d5f', 'f097ebb5-4647-446e-baf8-c1b85e981593', '0b152197-f3ae-43d4-9621-7732e5c4335f'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331922432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:30:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:30:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331922432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:30:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:30:22 user cinder-volume[84560]: INFO cinder.volume.manager [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Deleted volume successfully. Apr 14 00:30:22 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=58,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=7 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-781a4067-95d7-4bcf-9673-75d364b34d09 tempest-SnapshotMetadataTestJSON-2058312433 None] Lock "cinder-6ba9d78c-ee98-4a54-9e86-f00163e8e3d7-delete_volume" released by "delete_volume" :: held 3.452s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Flow 'volume_create_manager' (8cfdeae1-511b-49cf-8654-36a5a895c96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa937111-ed44-4c87-a39d-d5290e26858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa937111-ed44-4c87-a39d-d5290e26858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-310613987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3962140a-d7e3-4148-a0dc-370bc068a586,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a281d172b774da9bbde3ef5833cb768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:30:25Z,use_quota=True,user_id='51b4b2e3b26b4b7597a90e11c84d271f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f16ff6-7083-418f-bb5a-334b843c1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f16ff6-7083-418f-bb5a-334b843c1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f56c46d-5e96-406d-b929-83512b666230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f56c46d-5e96-406d-b929-83512b666230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3962140a-d7e3-4148-a0dc-370bc068a586', 'volume_name': 'volume-3962140a-d7e3-4148-a0dc-370bc068a586', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fbda2-3df8-4d83-b0db-c98626f218b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc0fbda2-3df8-4d83-b0db-c98626f218b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87da488-1c98-49bd-b762-d9aa2b568487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:24 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Volume 3962140a-d7e3-4148-a0dc-370bc068a586: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3962140a-d7e3-4148-a0dc-370bc068a586', 'volume_size': 1} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] creating volume v_3962140a-d7e3-4148-a0dc-370bc068a586. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] create volume {'name': 'v_3962140a-d7e3-4148-a0dc-370bc068a586', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_3962140a-d7e3-4148-a0dc-370bc068a586', 'is_clone': False, 'name': 'v_3962140a-d7e3-4148-a0dc-370bc068a586'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f87da488-1c98-49bd-b762-d9aa2b568487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3962140a-d7e3-4148-a0dc-370bc068a586', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931dc308-5a03-4d29-8b3d-3e2daee3c986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:30:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Volume volume-3962140a-d7e3-4148-a0dc-370bc068a586 (3962140a-d7e3-4148-a0dc-370bc068a586): created successfully Apr 14 00:30:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (931dc308-5a03-4d29-8b3d-3e2daee3c986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:30:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Flow 'volume_create_manager' (8cfdeae1-511b-49cf-8654-36a5a895c96a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:30:25 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b3588cbe-0237-45d8-86bd-09cc42952f8f tempest-VolumesMetadataTest-901487784 None] Created volume successfully. Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Acquiring lock "cinder-3962140a-d7e3-4148-a0dc-370bc068a586-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Lock "cinder-3962140a-d7e3-4148-a0dc-370bc068a586-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] remove_export for volume: 3962140a-d7e3-4148-a0dc-370bc068a586. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-310613987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=3962140a-d7e3-4148-a0dc-370bc068a586,launched_at=2023-04-14T00:30:26Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a281d172b774da9bbde3ef5833cb768',provider_auth='CHAP AqadUfDI wABg9RpfaNWX3h',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:30:25Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:30:27Z,updated_at=2023-04-14T00:30:27Z,use_quota=True,user_id='51b4b2e3b26b4b7597a90e11c84d271f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] detach volume v_3962140a-d7e3-4148-a0dc-370bc068a586 from target iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586/luns/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586/luns/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586/luns/v_3962140a-d7e3-4148-a0dc-370bc068a586'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586/luns/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] failed to remove resource iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 because of JDSS resource v_3962140a-d7e3-4148-a0dc-370bc068a586 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] delete target: iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] delete target iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] failed to remove resource iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 because of JDSS resource iqn.2010-10.org.openstack:3962140a-d7e3-4148-a0dc-370bc068a586 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] deleating volume v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] get snapshots for volume v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] get volume v_3962140a-d7e3-4148-a0dc-370bc068a586 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_3962140a-d7e3-4148-a0dc-370bc068a586', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433634', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108916', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15260963733466833819', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9ab51b82021ff83c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331852800', 'san:volume_id': '9ab51b82021ff83c4683366428fff289281d3fd9', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80688', 'name': 'v_3962140a-d7e3-4148-a0dc-370bc068a586', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] delete volume:v_3962140a-d7e3-4148-a0dc-370bc068a586 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_3962140a-d7e3-4148-a0dc-370bc068a586 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] volume v_3962140a-d7e3-4148-a0dc-370bc068a586 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.quota [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Created reservations ['d26d5d5c-0e5a-4f4a-a0ce-6c8551642252', '96b38170-499a-49cb-9005-a69c5410f0a7', 'a6691e99-07b7-4fef-95a8-8cbe324021ff', '19894dd8-9a7c-4b26-b72b-bfea676f5788'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=61,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:30:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:30:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331934720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:30:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:30:30 user cinder-volume[84560]: DEBUG cinder.manager [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:30:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Deleted volume successfully. Apr 14 00:30:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d053c69a-30c2-44ce-9096-550f75be3345 tempest-VolumesMetadataTest-901487784 None] Lock "cinder-3962140a-d7e3-4148-a0dc-370bc068a586-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:30:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=10,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331934720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:31:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:31:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] create export for volume: 282895bf-6b53-4106-a1e2-abc962b1c521. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] ensure volume 282895bf-6b53-4106-a1e2-abc962b1c521 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] check if targe iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] create target and attach volume 282895bf-6b53-4106-a1e2-abc962b1c521 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] create target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:31:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] atach volume v_282895bf-6b53-4106-a1e2-abc962b1c521 to target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:31:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3965386266396139', 'lun': 0, 'mode': 'wt', 'name': 'v_282895bf-6b53-4106-a1e2-abc962b1c521', 'prod_id': 'Storage', 'scsi_id': '9e8bf9a90be418f4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] add credentails to target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:31:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'name': 'BzLabHdv'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] initialize_connection for 282895bf-6b53-4106-a1e2-abc962b1c521 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:31:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BzLabHdv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'e2d21594-3b0f-4b66-8062-ec9ef9b386ee'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:31:39 user cinder-volume[84560]: INFO cinder.volume.manager [req-3b860bdb-dcd4-4169-a464-18c116308cbf req-6eed567a-6f49-4ad5-97f3-53edb8c5b257 tempest-VolumesSnapshotTestJSON-655184435 None] attachment_update completed successfully. Apr 14 00:31:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 3c46af29-4516-46a5-8144-9b69a938060d for volume 282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:31:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_282895bf-6b53-4106-a1e2-abc962b1c521 to s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:31:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:31:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_3c46af29-4516-46a5-8144-9b69a938060d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_3c46af29-4516-46a5-8144-9b69a938060d from snapshot s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:31:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_3c46af29-4516-46a5-8144-9b69a938060d', 'is_clone': True, 'full_name': 'Pool-0/s_3c46af29-4516-46a5-8144-9b69a938060d', 'name': 's_3c46af29-4516-46a5-8144-9b69a938060d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_3c46af29-4516-46a5-8144-9b69a938060d properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:31:44 user cinder-volume[84560]: INFO cinder.volume.manager [None req-37bf192c-2f47-497f-aea0-3cea32a5e673 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 1ce20d35-72fb-4318-87b8-1f66f9625d96 for volume 282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_282895bf-6b53-4106-a1e2-abc962b1c521 to s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_1ce20d35-72fb-4318-87b8-1f66f9625d96'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_1ce20d35-72fb-4318-87b8-1f66f9625d96 from snapshot s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:31:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_1ce20d35-72fb-4318-87b8-1f66f9625d96', 'is_clone': True, 'full_name': 'Pool-0/s_1ce20d35-72fb-4318-87b8-1f66f9625d96', 'name': 's_1ce20d35-72fb-4318-87b8-1f66f9625d96'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_1ce20d35-72fb-4318-87b8-1f66f9625d96 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:31:46 user cinder-volume[84560]: INFO cinder.volume.manager [None req-331bb6ce-be5e-4c11-9938-e05a0613e950 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-1ce20d35-72fb-4318-87b8-1f66f9625d96-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-1ce20d35-72fb-4318-87b8-1f66f9625d96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_1ce20d35-72fb-4318-87b8-1f66f9625d96. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_1ce20d35-72fb-4318-87b8-1f66f9625d96 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_1ce20d35-72fb-4318-87b8-1f66f9625d96', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_1ce20d35-72fb-4318-87b8-1f66f9625d96', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433715', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108946', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3678678185130357851', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '112ed3e6965f89f8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331860992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78578', 'name': 's_1ce20d35-72fb-4318-87b8-1f66f9625d96', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_1ce20d35-72fb-4318-87b8-1f66f9625d96 of volume v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_1ce20d35-72fb-4318-87b8-1f66f9625d96 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_1ce20d35-72fb-4318-87b8-1f66f9625d96 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.quota [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['0558ccc8-80a8-482d-8aa3-0004a86bbe0d', 'dd3c5600-5e98-4f6f-863a-5e33dbe8aa7d', 'e8220f66-ae62-4da6-849f-b01045e65179', '5d656e49-1eeb-45e2-a36d-dc0bfaf220aa'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:31:48 user cinder-volume[84560]: INFO cinder.volume.manager [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-23172e7b-1d9e-4acc-89a7-52144d0e02fe tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-1ce20d35-72fb-4318-87b8-1f66f9625d96-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-412462dc-00f2-4af9-b335-da6848c66dbd-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.coordination [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-412462dc-00f2-4af9-b335-da6848c66dbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_412462dc-00f2-4af9-b335-da6848c66dbd. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_412462dc-00f2-4af9-b335-da6848c66dbd info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_412462dc-00f2-4af9-b335-da6848c66dbd', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_412462dc-00f2-4af9-b335-da6848c66dbd', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433591', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108883', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16419089317015044925', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9116431fc7cd575f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331860992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79582', 'name': 's_412462dc-00f2-4af9-b335-da6848c66dbd', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_412462dc-00f2-4af9-b335-da6848c66dbd of volume v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_412462dc-00f2-4af9-b335-da6848c66dbd {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_412462dc-00f2-4af9-b335-da6848c66dbd deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:31:50 user cinder-volume[84560]: DEBUG cinder.quota [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['8d638cbb-d25e-488d-8525-f5f7e4420896', 'bf663b89-2c4b-43b4-8eea-ab063c5c011c', 'cf692f6c-6bcf-4708-b988-84349dfd5f0e', 'fd48b480-5d5b-495e-adbc-fd6416e7a87e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:31:50 user cinder-volume[84560]: INFO cinder.volume.manager [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:31:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-07c5d7ca-7d7c-4a53-837c-bce5388a331c tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-412462dc-00f2-4af9-b335-da6848c66dbd-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.coordination [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-3c46af29-4516-46a5-8144-9b69a938060d-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.coordination [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-3c46af29-4516-46a5-8144-9b69a938060d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_3c46af29-4516-46a5-8144-9b69a938060d. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_3c46af29-4516-46a5-8144-9b69a938060d info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521@s_3c46af29-4516-46a5-8144-9b69a938060d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_3c46af29-4516-46a5-8144-9b69a938060d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433713', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108940', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1587268558621793932', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '4502a16d87e73e61', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331922432', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80521', 'name': 's_3c46af29-4516-46a5-8144-9b69a938060d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_3c46af29-4516-46a5-8144-9b69a938060d of volume v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots/s_3c46af29-4516-46a5-8144-9b69a938060d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_3c46af29-4516-46a5-8144-9b69a938060d deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:31:53 user cinder-volume[84560]: DEBUG cinder.quota [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['75fba5a9-e7e4-4c66-b09b-78d957a68593', '1d0fe889-63d7-41af-8424-c303c15f6885', 'b778e2e5-9e58-419e-ba8b-3441f710fe62', '8e15ad29-5ab7-4ea3-a21e-2c8de3010479'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:31:53 user cinder-volume[84560]: INFO cinder.volume.manager [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:31:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-29519e70-73d1-4438-ac50-eefb4825843a tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-3c46af29-4516-46a5-8144-9b69a938060d-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] terminate connection for 282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:31:54 user cinder-volume[84560]: INFO cinder.volume.manager [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Terminate volume connection completed successfully. Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Deleting attachment e2d21594-3b0f-4b66-8062-ec9ef9b386ee. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 282895bf-6b53-4106-a1e2-abc962b1c521. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1043397576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=282895bf-6b53-4106-a1e2-abc962b1c521,launched_at=2023-04-14T00:26:25Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP BzLabHdv V4c3sKkmRNtzeZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:26:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:31:53Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_282895bf-6b53-4106-a1e2-abc962b1c521 from target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:31:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-1f158d65-06bf-4041-9756-81ed6cea459e req-d34aa3cc-9717-4f17-bd44-df92c18b5e1e tempest-VolumesSnapshotTestJSON-655184435 None] target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:32:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=43,cinder:UPDATE=23,cinder:DELETE=1,cinder:INSERT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=60,cinder:UPDATE=20,cinder:DELETE=1,cinder:INSERT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331897856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:32:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:32:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Flow 'volume_create_manager' (122b8f75-72b1-41a6-814b-1b21c6a568fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d39788-2337-4fdf-b766-eb27690c6662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8d39788-2337-4fdf-b766-eb27690c6662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1571439229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0f9e1f92-e142-4576-a375-32dc12d96c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46777f523af54eecb0e3260f14df7909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:32:39Z,use_quota=True,user_id='e5ad76f13b78448887913c4d0bcb16af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5fe14e-8372-4502-b387-68f8d3e924ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5fe14e-8372-4502-b387-68f8d3e924ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b03cf4c-9d05-41ea-a2b2-d3e3d35fa450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b03cf4c-9d05-41ea-a2b2-d3e3d35fa450) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9e1f92-e142-4576-a375-32dc12d96c82', 'volume_name': 'volume-0f9e1f92-e142-4576-a375-32dc12d96c82', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b811f0e9-672d-485d-b8db-72cd6ac2d148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b811f0e9-672d-485d-b8db-72cd6ac2d148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696ca171-2757-4cfe-ae54-3554c6ece458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:39 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Volume 0f9e1f92-e142-4576-a375-32dc12d96c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9e1f92-e142-4576-a375-32dc12d96c82', 'volume_size': 1} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] creating volume v_0f9e1f92-e142-4576-a375-32dc12d96c82. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] create volume {'name': 'v_0f9e1f92-e142-4576-a375-32dc12d96c82', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_0f9e1f92-e142-4576-a375-32dc12d96c82', 'is_clone': False, 'name': 'v_0f9e1f92-e142-4576-a375-32dc12d96c82'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696ca171-2757-4cfe-ae54-3554c6ece458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9e1f92-e142-4576-a375-32dc12d96c82', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb8ba14-f524-444f-aba2-eef314aecf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:40 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Volume volume-0f9e1f92-e142-4576-a375-32dc12d96c82 (0f9e1f92-e142-4576-a375-32dc12d96c82): created successfully Apr 14 00:32:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb8ba14-f524-444f-aba2-eef314aecf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Flow 'volume_create_manager' (122b8f75-72b1-41a6-814b-1b21c6a568fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:32:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-63b63331-c5ba-4841-b097-a9017395aab4 tempest-TestMinimumBasicScenario-598834355 None] Created volume successfully. Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] create export for volume: 0f9e1f92-e142-4576-a375-32dc12d96c82. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] ensure volume 0f9e1f92-e142-4576-a375-32dc12d96c82 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] check if targe iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] create target and attach volume 0f9e1f92-e142-4576-a375-32dc12d96c82 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] create target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] atach volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 to target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:32:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (da83d8fa-9ee6-4eb5-9493-86b39abab5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfac5dc-1622-40d9-93af-305616f6a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dfac5dc-1622-40d9-93af-305616f6a623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-963887210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=87c296d5-0746-4a8f-a36e-c44150d5f3c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:32:44Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bb0bcd-8d0c-40b7-ba89-0d5dadd63c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bb0bcd-8d0c-40b7-ba89-0d5dadd63c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5bf7ed-d0b2-4b47-858e-9c2ac2812c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5bf7ed-d0b2-4b47-858e-9c2ac2812c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'volume_name': 'volume-87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe2c14f-6b41-4e08-a9aa-f8712e433eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe2c14f-6b41-4e08-a9aa-f8712e433eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8040f3c5-862f-4f82-a77a-e2342abe3b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:44 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Volume 87c296d5-0746-4a8f-a36e-c44150d5f3c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'volume_size': 1} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] creating volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] create volume {'name': 'v_87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6266376662366566', 'lun': 0, 'mode': 'wt', 'name': 'v_0f9e1f92-e142-4576-a375-32dc12d96c82', 'prod_id': 'Storage', 'scsi_id': 'bf7fb6efc1e8741a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] add credentails to target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'is_clone': False, 'name': 'v_87c296d5-0746-4a8f-a36e-c44150d5f3c2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8040f3c5-862f-4f82-a77a-e2342abe3b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1449d40-c65c-4b61-8567-823da3a93654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:45 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Volume volume-87c296d5-0746-4a8f-a36e-c44150d5f3c2 (87c296d5-0746-4a8f-a36e-c44150d5f3c2): created successfully Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1449d40-c65c-4b61-8567-823da3a93654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (da83d8fa-9ee6-4eb5-9493-86b39abab5d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:32:45 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b09994bb-d0cb-4921-a716-f12cd8910994 tempest-VolumesSnapshotTestJSON-655184435 None] Created volume successfully. Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nrgBiqQL'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] initialize_connection for 0f9e1f92-e142-4576-a375-32dc12d96c82 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:32:45 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nrgBiqQL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '6ae724da-49f3-455b-a3a2-7986cfb73c5e'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:32:46 user cinder-volume[84560]: INFO cinder.volume.manager [req-f9f930ce-f1fc-4de5-be61-4d576644b325 req-88daa15f-db31-4162-aa1e-02d499c1e8e5 tempest-TestMinimumBasicScenario-598834355 None] attachment_update completed successfully. Apr 14 00:32:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 933a5059-3167-4dc5-b35e-eccdfd8554ef for volume 87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:32:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 to s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:32:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:32:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_933a5059-3167-4dc5-b35e-eccdfd8554ef'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_933a5059-3167-4dc5-b35e-eccdfd8554ef from snapshot s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:32:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2@s_933a5059-3167-4dc5-b35e-eccdfd8554ef', 'is_clone': True, 'full_name': 'Pool-0/s_933a5059-3167-4dc5-b35e-eccdfd8554ef', 'name': 's_933a5059-3167-4dc5-b35e-eccdfd8554ef'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] volume s_933a5059-3167-4dc5-b35e-eccdfd8554ef properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:32:48 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2630c481-65d5-47ca-bd28-e3f949e00c1c tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] create snapshot c4dab5dc-4021-48e9-a0fc-c738fe1bed7d for volume 0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] cloning v_0f9e1f92-e142-4576-a375-32dc12d96c82 to s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] create snapshot s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (439b845b-b084-41f5-929d-41fbc76c3558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654ce18b-25be-48da-ba21-541694a770c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (654ce18b-25be-48da-ba21-541694a770c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-535634705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2f0f366b-e1a0-4786-b173-f032a2a506e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=933a5059-3167-4dc5-b35e-eccdfd8554ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:32:49Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86caa418-99a4-47c6-b8c6-5ef3918963e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86caa418-99a4-47c6-b8c6-5ef3918963e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828fa3a6-88c2-49be-9e71-fc851f377195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (828fa3a6-88c2-49be-9e71-fc851f377195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f0f366b-e1a0-4786-b173-f032a2a506e2', 'volume_name': 'volume-2f0f366b-e1a0-4786-b173-f032a2a506e2', 'volume_size': 2, 'snapshot_id': '933a5059-3167-4dc5-b35e-eccdfd8554ef'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f092802-db7a-4ef6-a3e3-a8131c1fc50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f092802-db7a-4ef6-a3e3-a8131c1fc50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86273de-fcba-4c2c-b487-3abe2bedf8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:48 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Volume 2f0f366b-e1a0-4786-b173-f032a2a506e2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f0f366b-e1a0-4786-b173-f032a2a506e2', 'volume_size': 2, 'snapshot_id': '933a5059-3167-4dc5-b35e-eccdfd8554ef'} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] create volume 2f0f366b-e1a0-4786-b173-f032a2a506e2 from snapshot 933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] cloning s_933a5059-3167-4dc5-b35e-eccdfd8554ef to v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] create volume s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d from snapshot s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:32:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_2f0f366b-e1a0-4786-b173-f032a2a506e2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] create volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 from snapshot v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:32:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0f9e1f92-e142-4576-a375-32dc12d96c82@s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d', 'is_clone': True, 'full_name': 'Pool-0/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d', 'name': 's_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_933a5059-3167-4dc5-b35e-eccdfd8554ef@v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'is_clone': True, 'full_name': 'Pool-0/v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'name': 'v_2f0f366b-e1a0-4786-b173-f032a2a506e2'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] volume s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:32:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b4925b6d-9287-47f8-825a-1c1eddd9c115 tempest-TestMinimumBasicScenario-598834355 None] Create snapshot completed successfully Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_933a5059-3167-4dc5-b35e-eccdfd8554ef@v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433781', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108996', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17506998972538342063', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c9f5570b74fbc73f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331672576', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80829', 'name': 'v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Extend volume 2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] jdss extend volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 to 2147483648 {{(pid=84560) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b86273de-fcba-4c2c-b487-3abe2bedf8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f0f366b-e1a0-4786-b173-f032a2a506e2', 'volume_size': 2, 'snapshot_id': '933a5059-3167-4dc5-b35e-eccdfd8554ef'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baff683a-c78c-41b4-bd9e-f0726847788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:32:52 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Volume volume-2f0f366b-e1a0-4786-b173-f032a2a506e2 (2f0f366b-e1a0-4786-b173-f032a2a506e2): created successfully Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baff683a-c78c-41b4-bd9e-f0726847788a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:32:52 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (439b845b-b084-41f5-929d-41fbc76c3558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:32:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9aae020b-f8fb-4847-a178-b5c1be322c88 tempest-VolumesSnapshotTestJSON-655184435 None] Created volume successfully. Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-2f0f366b-e1a0-4786-b173-f032a2a506e2-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.coordination [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-2f0f366b-e1a0-4786-b173-f032a2a506e2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 2f0f366b-e1a0-4786-b173-f032a2a506e2. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-535634705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2f0f366b-e1a0-4786-b173-f032a2a506e2,launched_at=2023-04-14T00:32:53Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP XRbCAzOu PQTn1Flb0W4Edi',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:49Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=933a5059-3167-4dc5-b35e-eccdfd8554ef,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:32:53Z,updated_at=2023-04-14T00:32:53Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 from target iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2/luns/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2/luns/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2/luns/v_2f0f366b-e1a0-4786-b173-f032a2a506e2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2/luns/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 because of JDSS resource v_2f0f366b-e1a0-4786-b173-f032a2a506e2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 because of JDSS resource iqn.2010-10.org.openstack:2f0f366b-e1a0-4786-b173-f032a2a506e2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] deleating volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_2f0f366b-e1a0-4786-b173-f032a2a506e2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_933a5059-3167-4dc5-b35e-eccdfd8554ef@v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433781', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108996', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17506998972538342063', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'c9f5570b74fbc73f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331578368', 'san:volume_id': 'c9f5570b74fbc73f92b7b90aa854566884c138c8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80829', 'name': 'v_2f0f366b-e1a0-4786-b173-f032a2a506e2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot v_2f0f366b-e1a0-4786-b173-f032a2a506e2 of volume s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots/v_2f0f366b-e1a0-4786-b173-f032a2a506e2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] snapshot v_2f0f366b-e1a0-4786-b173-f032a2a506e2 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.quota [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['65f9ec98-39c9-4a62-8b85-ee8c9b8f1641', 'b9cf56e3-35c8-49d5-92bb-3d5b99bb547e', '21726fc9-3f71-40cf-991c-46317747d910', '9500e854-c4ee-4cae-974c-79f30bb380a2'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-933a5059-3167-4dc5-b35e-eccdfd8554ef-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-933a5059-3167-4dc5-b35e-eccdfd8554ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_933a5059-3167-4dc5-b35e-eccdfd8554ef. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=47,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331672576', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.manager [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:32:55 user cinder-volume[84560]: INFO cinder.volume.manager [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Deleted volume successfully. Apr 14 00:32:55 user cinder-volume[84560]: DEBUG cinder.coordination [None req-da7f4b06-8c7f-4fb9-a096-0c1bacdd8d60 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-2f0f366b-e1a0-4786-b173-f032a2a506e2-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_933a5059-3167-4dc5-b35e-eccdfd8554ef info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2@s_933a5059-3167-4dc5-b35e-eccdfd8554ef', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_933a5059-3167-4dc5-b35e-eccdfd8554ef', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433777', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108985', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3629628220392162521', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '69ec0d5d71a0cfc8', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331672576', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80798', 'name': 's_933a5059-3167-4dc5-b35e-eccdfd8554ef', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_933a5059-3167-4dc5-b35e-eccdfd8554ef of volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots/s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots/s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Acquiring lock "cinder-c4dab5dc-4021-48e9-a0fc-c738fe1bed7d-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Lock "cinder-c4dab5dc-4021-48e9-a0fc-c738fe1bed7d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] deleating snapshot s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] get snapshots for volume s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots/s_933a5059-3167-4dc5-b35e-eccdfd8554ef {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_933a5059-3167-4dc5-b35e-eccdfd8554ef deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:32:57 user cinder-volume[84560]: DEBUG cinder.quota [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['68b2ecc9-8c18-43eb-82b6-25cc50ee5738', '48bfcfce-6e5c-4352-a18f-90374148f958', 'a092658b-6193-4820-8538-ebd6c31cefa0', 'c135d4fc-54b1-4301-bec4-fb9d519760ce'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:32:57 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=63,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:32:57 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:32:57 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3d388ec3-48f2-40be-be05-483296cfa060 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-933a5059-3167-4dc5-b35e-eccdfd8554ef-delete_snapshot" released by "delete_snapshot" :: held 2.395s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] get volume s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_0f9e1f92-e142-4576-a375-32dc12d96c82@s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433780', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108993', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '15425478891606334401', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '59d446afddf2c113', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331721728', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80818', 'name': 's_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] delete snapshot s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d of volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-87c296d5-0746-4a8f-a36e-c44150d5f3c2-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-87c296d5-0746-4a8f-a36e-c44150d5f3c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 87c296d5-0746-4a8f-a36e-c44150d5f3c2. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-963887210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=87c296d5-0746-4a8f-a36e-c44150d5f3c2,launched_at=2023-04-14T00:32:46Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP xtyFpZJq PscLwmxbzTtXFJ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:44Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:32:59Z,updated_at=2023-04-14T00:32:59Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 from target iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2/luns/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2/luns/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots/s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] snapshot s_c4dab5dc-4021-48e9-a0fc-c738fe1bed7d deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2/luns/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2/luns/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 because of JDSS resource v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.quota [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Created reservations ['d98254c4-b5f7-4c1c-ae3c-a2e274165d4c', '3e4ab67b-81c7-4f80-b728-3d363d741196', 'ff2d3400-7686-4be4-8cda-523c34396900', '2004c216-389c-4f1f-8dc3-123a13546385'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 because of JDSS resource iqn.2010-10.org.openstack:87c296d5-0746-4a8f-a36e-c44150d5f3c2 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] deleating volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:32:59 user cinder-volume[84560]: INFO cinder.volume.manager [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Delete snapshot completed successfully. Apr 14 00:32:59 user cinder-volume[84560]: DEBUG cinder.coordination [None req-670431fe-a736-4c00-974b-052cd1ba133c tempest-TestMinimumBasicScenario-598834355 None] Lock "cinder-c4dab5dc-4021-48e9-a0fc-c738fe1bed7d-delete_snapshot" released by "delete_snapshot" :: held 3.087s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433775', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108979', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17004638340158295306', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '97439de78bfeac46', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331721728', 'san:volume_id': '97439de78bfeac464c185a6fc142d44686ca460e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80785', 'name': 'v_87c296d5-0746-4a8f-a36e-c44150d5f3c2', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] delete volume:v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] volume v_87c296d5-0746-4a8f-a36e-c44150d5f3c2 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:33:01 user cinder-volume[84560]: DEBUG cinder.quota [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['8e94f35a-1445-44a2-bfd2-702abe0b0a17', '77d7e728-bcd9-4139-995e-d2edc797290e', '971b7561-55b9-425d-9f45-8cde7cb195a6', 'f4d86ede-05b2-4a47-8e9b-90a229132209'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (c9348b67-93fc-4f83-8d05-1fcbd14a345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334044ea-eaec-459c-bf45-bd5dea1f4d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334044ea-eaec-459c-bf45-bd5dea1f4d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524862204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=14016b32-2cca-4ec9-b924-98e8cb959537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:33:02Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a408d-c3ce-4818-ab9d-b7e63b8f4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e46a408d-c3ce-4818-ab9d-b7e63b8f4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85be15d-1e88-4257-b10b-7950a3c1ca8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a85be15d-1e88-4257-b10b-7950a3c1ca8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14016b32-2cca-4ec9-b924-98e8cb959537', 'volume_name': 'volume-14016b32-2cca-4ec9-b924-98e8cb959537', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96097d30-566a-49dd-8e21-250133e0c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96097d30-566a-49dd-8e21-250133e0c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972a1b6d-2d98-49bd-910c-a569a942aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:02 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Volume 14016b32-2cca-4ec9-b924-98e8cb959537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14016b32-2cca-4ec9-b924-98e8cb959537', 'volume_size': 1} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] creating volume v_14016b32-2cca-4ec9-b924-98e8cb959537. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] create volume {'name': 'v_14016b32-2cca-4ec9-b924-98e8cb959537', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331803648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.manager [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:02 user cinder-volume[84560]: INFO cinder.volume.manager [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Deleted volume successfully. Apr 14 00:33:02 user cinder-volume[84560]: DEBUG cinder.coordination [None req-775c4106-d1eb-4a73-b0be-6bc82dd8ec62 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-87c296d5-0746-4a8f-a36e-c44150d5f3c2-delete_volume" released by "delete_volume" :: held 3.960s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_14016b32-2cca-4ec9-b924-98e8cb959537', 'is_clone': False, 'name': 'v_14016b32-2cca-4ec9-b924-98e8cb959537'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972a1b6d-2d98-49bd-910c-a569a942aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14016b32-2cca-4ec9-b924-98e8cb959537', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940199f7-f98f-414b-ab78-90c6fdf56d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:03 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Volume volume-14016b32-2cca-4ec9-b924-98e8cb959537 (14016b32-2cca-4ec9-b924-98e8cb959537): created successfully Apr 14 00:33:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940199f7-f98f-414b-ab78-90c6fdf56d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (c9348b67-93fc-4f83-8d05-1fcbd14a345d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:03 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5ece1567-c730-4673-ae8a-0f3e83f0414b tempest-VolumesSnapshotTestJSON-655184435 None] Created volume successfully. Apr 14 00:33:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot 77a93020-175e-48f6-88ca-395771b0a16f for volume 14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:33:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] cloning v_14016b32-2cca-4ec9-b924-98e8cb959537 to s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:33:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:33:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_77a93020-175e-48f6-88ca-395771b0a16f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] create volume s_77a93020-175e-48f6-88ca-395771b0a16f from snapshot s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:33:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_14016b32-2cca-4ec9-b924-98e8cb959537@s_77a93020-175e-48f6-88ca-395771b0a16f', 'is_clone': True, 'full_name': 'Pool-0/s_77a93020-175e-48f6-88ca-395771b0a16f', 'name': 's_77a93020-175e-48f6-88ca-395771b0a16f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] volume s_77a93020-175e-48f6-88ca-395771b0a16f properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:33:06 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0e210620-dcb0-4d00-a277-1beea7b34177 tempest-VolumesSnapshotTestJSON-655184435 None] Create snapshot completed successfully Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (f52bd757-7061-4e4c-b145-236cb8036a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd7574c-cd72-4a16-b368-28a09dac7de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cd7574c-cd72-4a16-b368-28a09dac7de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-100523397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8dc529a6-34bc-4880-9ea2-2ecf7f0831b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=77a93020-175e-48f6-88ca-395771b0a16f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:33:07Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b68d964-e9d4-4902-b42c-c3be4d543063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b68d964-e9d4-4902-b42c-c3be4d543063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9ae3ea-47f8-494e-84e5-cd6bfd13f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9ae3ea-47f8-494e-84e5-cd6bfd13f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'volume_name': 'volume-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'volume_size': 1, 'snapshot_id': '77a93020-175e-48f6-88ca-395771b0a16f'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74bd59c-d7a8-4978-8f86-84d3359de9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74bd59c-d7a8-4978-8f86-84d3359de9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2558a2ca-a024-46a3-ac23-4b69c65bf9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:07 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Volume 8dc529a6-34bc-4880-9ea2-2ecf7f0831b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'volume_size': 1, 'snapshot_id': '77a93020-175e-48f6-88ca-395771b0a16f'} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] create volume 8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 from snapshot 77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] cloning s_77a93020-175e-48f6-88ca-395771b0a16f to v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] create snapshot v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] create volume v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 from snapshot v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_77a93020-175e-48f6-88ca-395771b0a16f@v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'is_clone': True, 'full_name': 'Pool-0/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'name': 'v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_77a93020-175e-48f6-88ca-395771b0a16f@v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433797', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109026', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5114885810453455634', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5e5ffc043fdbfe34', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331709440', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79850', 'name': 'v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2558a2ca-a024-46a3-ac23-4b69c65bf9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'volume_size': 1, 'snapshot_id': '77a93020-175e-48f6-88ca-395771b0a16f'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c315bfd4-c2f7-45ba-a2db-b47dc0ed2f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:09 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Volume volume-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 (8dc529a6-34bc-4880-9ea2-2ecf7f0831b4): created successfully Apr 14 00:33:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c315bfd4-c2f7-45ba-a2db-b47dc0ed2f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:09 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Flow 'volume_create_manager' (f52bd757-7061-4e4c-b145-236cb8036a58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:09 user cinder-volume[84560]: INFO cinder.volume.manager [None req-e6fa7b91-9eac-49e3-bc3a-1a1ea2287e2e tempest-VolumesSnapshotTestJSON-655184435 None] Created volume successfully. Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 8dc529a6-34bc-4880-9ea2-2ecf7f0831b4. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-100523397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8dc529a6-34bc-4880-9ea2-2ecf7f0831b4,launched_at=2023-04-14T00:33:09Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP xvCAypgL 20IEQXl8tPFczb',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:07Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=77a93020-175e-48f6-88ca-395771b0a16f,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:33:10Z,updated_at=2023-04-14T00:33:10Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 from target iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/luns/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/luns/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/luns/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/luns/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 because of JDSS resource v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 because of JDSS resource iqn.2010-10.org.openstack:8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] deleating volume v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_77a93020-175e-48f6-88ca-395771b0a16f@v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433797', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109026', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5114885810453455634', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '5e5ffc043fdbfe34', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331697152', 'san:volume_id': '5e5ffc043fdbfe34ae79d98a9fac6061b56ec140', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79850', 'name': 'v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 of volume s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots/v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] snapshot v_8dc529a6-34bc-4880-9ea2-2ecf7f0831b4 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.quota [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['7439b3f7-4daf-48ce-856c-ea51379544b2', 'c68454e0-c9c7-4ffb-bc31-429ce0ec0d4e', 'e9a6e232-83a0-460d-a38e-f53745db7476', '96ec7c2d-1212-4cab-ae2a-56d3edfc270e'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331709440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.manager [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:13 user cinder-volume[84560]: INFO cinder.volume.manager [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Deleted volume successfully. Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.coordination [None req-bc116ba1-8ace-4b21-8571-1efddb2f884a tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-8dc529a6-34bc-4880-9ea2-2ecf7f0831b4-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.coordination [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-77a93020-175e-48f6-88ca-395771b0a16f-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.coordination [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-77a93020-175e-48f6-88ca-395771b0a16f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] deleating snapshot s_77a93020-175e-48f6-88ca-395771b0a16f. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] get volume s_77a93020-175e-48f6-88ca-395771b0a16f info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_14016b32-2cca-4ec9-b924-98e8cb959537@s_77a93020-175e-48f6-88ca-395771b0a16f', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_77a93020-175e-48f6-88ca-395771b0a16f', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433795', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109020', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '5795292435234923433', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '7c8d21dbd73b38b0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331709440', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80872', 'name': 's_77a93020-175e-48f6-88ca-395771b0a16f', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] delete snapshot s_77a93020-175e-48f6-88ca-395771b0a16f of volume v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots/s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots/s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots/s_77a93020-175e-48f6-88ca-395771b0a16f {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] snapshot s_77a93020-175e-48f6-88ca-395771b0a16f deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:33:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=68,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:15 user cinder-volume[84560]: DEBUG cinder.quota [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['80f33969-8578-4d8e-bfa8-8ae695cf88a6', 'd1907d4d-3ca3-4e7e-abed-2f5d4e0711a3', 'db68ee00-d1ed-4d65-9b44-1ebb63fd1f2a', '7181e158-0f4e-457b-ae2d-dadf5a9af877'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=52,cinder:UPDATE=32,cinder:INSERT=12,cinder:DELETE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:15 user cinder-volume[84560]: INFO cinder.volume.manager [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Delete snapshot completed successfully. Apr 14 00:33:15 user cinder-volume[84560]: DEBUG cinder.coordination [None req-57b16edc-10e4-4a95-9684-8eb100a8c8f9 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-77a93020-175e-48f6-88ca-395771b0a16f-delete_snapshot" released by "delete_snapshot" :: held 2.127s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-14016b32-2cca-4ec9-b924-98e8cb959537-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-14016b32-2cca-4ec9-b924-98e8cb959537-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 14016b32-2cca-4ec9-b924-98e8cb959537. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1524862204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=14016b32-2cca-4ec9-b924-98e8cb959537,launched_at=2023-04-14T00:33:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP Idhmrsov U8lZ1WE3NQxoYy',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:02Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:33:17Z,updated_at=2023-04-14T00:33:17Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_14016b32-2cca-4ec9-b924-98e8cb959537 from target iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537/luns/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537/luns/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537/luns/v_14016b32-2cca-4ec9-b924-98e8cb959537'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537/luns/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 because of JDSS resource v_14016b32-2cca-4ec9-b924-98e8cb959537 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 because of JDSS resource iqn.2010-10.org.openstack:14016b32-2cca-4ec9-b924-98e8cb959537 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] deleating volume v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_14016b32-2cca-4ec9-b924-98e8cb959537 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_14016b32-2cca-4ec9-b924-98e8cb959537', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433792', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109014', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17304585537559422827', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'cc47f333f36669f7', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331721728', 'san:volume_id': 'cc47f333f36669f7883c344e798469c055dae50b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80861', 'name': 'v_14016b32-2cca-4ec9-b924-98e8cb959537', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] delete volume:v_14016b32-2cca-4ec9-b924-98e8cb959537 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_14016b32-2cca-4ec9-b924-98e8cb959537 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] volume v_14016b32-2cca-4ec9-b924-98e8cb959537 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.quota [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['f4eb6efa-47bd-4050-979d-15b156e7e159', 'f8c82926-7461-45b2-8f1d-92c19e2d5bf0', 'efb1a7b9-dfc1-4e20-93ca-8bbbf83b8d63', 'ab63778a-406d-4ec6-8344-151a142da558'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331803648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:19 user cinder-volume[84560]: DEBUG cinder.manager [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Deleted volume successfully. Apr 14 00:33:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b39f3066-c5f9-4b7e-befe-1e538f918703 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-14016b32-2cca-4ec9-b924-98e8cb959537-delete_volume" released by "delete_volume" :: held 2.974s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Acquiring lock "cinder-282895bf-6b53-4106-a1e2-abc962b1c521-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-282895bf-6b53-4106-a1e2-abc962b1c521-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] remove_export for volume: 282895bf-6b53-4106-a1e2-abc962b1c521. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1043397576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=282895bf-6b53-4106-a1e2-abc962b1c521,launched_at=2023-04-14T00:26:25Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851640ccdac240bcb6b9b0a89dd250d8',provider_auth='CHAP BzLabHdv V4c3sKkmRNtzeZ',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:26:24Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:33:20Z,updated_at=2023-04-14T00:33:20Z,use_quota=True,user_id='f922c56244e442028d3265b23a8fffd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] detach volume v_282895bf-6b53-4106-a1e2-abc962b1c521 from target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521/luns/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 because of JDSS resource v_282895bf-6b53-4106-a1e2-abc962b1c521 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] delete target: iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] delete target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] failed to remove resource iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 because of JDSS resource iqn.2010-10.org.openstack:282895bf-6b53-4106-a1e2-abc962b1c521 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] deleating volume v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] get snapshots for volume v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] get volume v_282895bf-6b53-4106-a1e2-abc962b1c521 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_282895bf-6b53-4106-a1e2-abc962b1c521', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433393', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108787', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6086263730917690508', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '9e8bf9a90be418f4', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331803648', 'san:volume_id': '9e8bf9a90be418f4db68a18769ffa3fbc09f3eb6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '78565', 'name': 'v_282895bf-6b53-4106-a1e2-abc962b1c521', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] delete volume:v_282895bf-6b53-4106-a1e2-abc962b1c521 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331803648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_282895bf-6b53-4106-a1e2-abc962b1c521 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] volume v_282895bf-6b53-4106-a1e2-abc962b1c521 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.quota [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Created reservations ['57dfda94-f5c3-454e-9e32-127583ddcbdd', '2e2edd31-25e5-4f5b-bbb5-af1aa6b33fc4', 'dab099d5-7352-461b-baa7-2ddd0003e167', '636be40e-3a7e-4aba-865b-2cc4ce53bbae'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331934720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:23 user cinder-volume[84560]: DEBUG cinder.manager [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:23 user cinder-volume[84560]: INFO cinder.volume.manager [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Deleted volume successfully. Apr 14 00:33:23 user cinder-volume[84560]: DEBUG cinder.coordination [None req-4579dbb7-dfbb-4b8b-97c1-4cba3d791a06 tempest-VolumesSnapshotTestJSON-655184435 None] Lock "cinder-282895bf-6b53-4106-a1e2-abc962b1c521-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Flow 'volume_create_manager' (56bf6710-7318-40e7-bb9b-6d404d3e9973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dc80b6-ba7b-4618-bc44-18eb46c60a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76dc80b6-ba7b-4618-bc44-18eb46c60a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2028180304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6233bd0f-d400-4c8d-9aad-e052a2ae8f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46ba54fdcdb45368f457001f26a281b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:33:26Z,use_quota=True,user_id='67248d6b437547918b0cc2b0cdf29536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2842b9-adcc-4765-af5f-18cbd70bfcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2842b9-adcc-4765-af5f-18cbd70bfcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2860e3-1f4a-4e49-a9dc-4d157e09b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe2860e3-1f4a-4e49-a9dc-4d157e09b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'volume_name': 'volume-6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff370c8-e16c-4d60-b15a-f44f2cb77fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff370c8-e16c-4d60-b15a-f44f2cb77fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e07099c-2ec4-4476-bda6-fddb5a265312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Volume 6233bd0f-d400-4c8d-9aad-e052a2ae8f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'volume_size': 1} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] creating volume v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] create volume {'name': 'v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Flow 'volume_create_manager' (36d73bc0-5125-4a89-8f4f-5ec02926db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e69a7-27e2-4d0f-b74a-1418ca9cf6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e04e69a7-27e2-4d0f-b74a-1418ca9cf6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-125976324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ad5b2c57-b71f-40a0-81b4-81907e5f1250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c488416d8d7418eaff51ad824a408d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:33:26Z,use_quota=True,user_id='9ff7ef99590c4bdeb592373970b395f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33cae6e-2a36-4a06-870d-6c589f9f6258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33cae6e-2a36-4a06-870d-6c589f9f6258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6814aa63-4043-4916-8274-465f6461f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6814aa63-4043-4916-8274-465f6461f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'volume_name': 'volume-ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e27665-b3d1-4db4-96a2-d0b688b51905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0e27665-b3d1-4db4-96a2-d0b688b51905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60eb0e07-05d6-41be-8700-96e47da9e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:25 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Volume ad5b2c57-b71f-40a0-81b4-81907e5f1250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'volume_size': 1} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] creating volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] create volume {'name': 'v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'is_clone': False, 'name': 'v_ad5b2c57-b71f-40a0-81b4-81907e5f1250'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'is_clone': False, 'name': 'v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60eb0e07-05d6-41be-8700-96e47da9e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9508d4da-65ff-4b9f-8e33-d85c13b5b3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e07099c-2ec4-4476-bda6-fddb5a265312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cc9611-7602-4b14-902a-f31c878de6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Volume volume-ad5b2c57-b71f-40a0-81b4-81907e5f1250 (ad5b2c57-b71f-40a0-81b4-81907e5f1250): created successfully Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9508d4da-65ff-4b9f-8e33-d85c13b5b3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Flow 'volume_create_manager' (36d73bc0-5125-4a89-8f4f-5ec02926db61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:26 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Volume volume-6233bd0f-d400-4c8d-9aad-e052a2ae8f21 (6233bd0f-d400-4c8d-9aad-e052a2ae8f21): created successfully Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5cc9611-7602-4b14-902a-f31c878de6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Flow 'volume_create_manager' (56bf6710-7318-40e7-bb9b-6d404d3e9973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-88154f99-7f01-47f3-93f0-20d34351945f tempest-VolumeRevertTests-1633795360 None] Created volume successfully. Apr 14 00:33:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6619db52-477d-421f-bd68-957617dce8c9 tempest-ServersNegativeTestJSON-495782531 None] Created volume successfully. Apr 14 00:33:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] create snapshot 29480e6a-de46-4d11-b910-737a9695abd8 for volume ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:33:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] cloning v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 to s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:33:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] create snapshot s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:33:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_29480e6a-de46-4d11-b910-737a9695abd8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] create volume s_29480e6a-de46-4d11-b910-737a9695abd8 from snapshot s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250@s_29480e6a-de46-4d11-b910-737a9695abd8', 'is_clone': True, 'full_name': 'Pool-0/s_29480e6a-de46-4d11-b910-737a9695abd8', 'name': 's_29480e6a-de46-4d11-b910-737a9695abd8'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] volume s_29480e6a-de46-4d11-b910-737a9695abd8 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:33:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-9c4c8c6e-0048-44aa-95bd-c72cafd2dcb6 tempest-VolumeRevertTests-1633795360 None] Create snapshot completed successfully Apr 14 00:33:30 user cinder-volume[84560]: INFO cinder.volume.manager [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Start to perform revert to snapshot process. Apr 14 00:33:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] create snapshot 0f1eca1b-58be-411e-bd10-3212ce199e74 for volume ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:33:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] cloning v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 to s_0f1eca1b-58be-411e-bd10-3212ce199e74 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:33:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] create snapshot s_0f1eca1b-58be-411e-bd10-3212ce199e74 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:33:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_0f1eca1b-58be-411e-bd10-3212ce199e74'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] create volume s_0f1eca1b-58be-411e-bd10-3212ce199e74 from snapshot s_0f1eca1b-58be-411e-bd10-3212ce199e74 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250@s_0f1eca1b-58be-411e-bd10-3212ce199e74', 'is_clone': True, 'full_name': 'Pool-0/s_0f1eca1b-58be-411e-bd10-3212ce199e74', 'name': 's_0f1eca1b-58be-411e-bd10-3212ce199e74'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] volume s_0f1eca1b-58be-411e-bd10-3212ce199e74 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:33:32 user cinder-volume[84560]: INFO cinder.volume.manager [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Create snapshot completed successfully Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] reverting v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 to s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) revert_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:420}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] get volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433816', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109040', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16940197383635465559', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0b77f2e73149abd1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331660288', 'san:volume_id': '0b77f2e73149abd151147d13dd48ec7910ca8232', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80536', 'name': 'v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] rollback volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 to snapshot s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) rollback_volume_to_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:707}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots/s_29480e6a-de46-4d11-b910-737a9695abd8/rollback {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots/s_29480e6a-de46-4d11-b910-737a9695abd8/rollback {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': None} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots/s_29480e6a-de46-4d11-b910-737a9695abd8/rollback {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] get volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433816', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109040', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16940197383635465559', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0b77f2e73149abd1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331672576', 'san:volume_id': '0b77f2e73149abd151147d13dd48ec7910ca8232', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80536', 'name': 'v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Acquiring lock "cinder-0f1eca1b-58be-411e-bd10-3212ce199e74-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Lock "cinder-0f1eca1b-58be-411e-bd10-3212ce199e74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] deleating snapshot s_0f1eca1b-58be-411e-bd10-3212ce199e74. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] get snapshots for volume s_0f1eca1b-58be-411e-bd10-3212ce199e74 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Geting {'code': 500, 'error': {'class': 'zfslib.zfsapi.resources.ZfsResourceError', 'errno': 1, 'message': 'Zfs resource: Pool-0/s_0f1eca1b-58be-411e-bd10-3212ce199e74 not found in this collection.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/snapshots'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_0f1eca1b-58be-411e-bd10-3212ce199e74/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] physical volume s_0f1eca1b-58be-411e-bd10-3212ce199e74 dne, it was already deleted. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:655}} Apr 14 00:33:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Delete snapshot completed successfully. Apr 14 00:33:36 user cinder-volume[84560]: DEBUG cinder.coordination [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Lock "cinder-0f1eca1b-58be-411e-bd10-3212ce199e74-delete_snapshot" released by "delete_snapshot" :: held 0.038s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:36 user cinder-volume[84560]: INFO cinder.volume.manager [None req-71c2eb91-618a-47c4-8aa0-ebd66f76a25f tempest-VolumeRevertTests-1633795360 None] Volume ad5b2c57-b71f-40a0-81b4-81907e5f1250 reverted to snapshot 29480e6a-de46-4d11-b910-737a9695abd8 successfully. Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Flow 'volume_create_manager' (10477275-e74b-420f-bf60-cb18a2bcdea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d09b1f-f5bd-4d6f-910a-dda5098a7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82d09b1f-f5bd-4d6f-910a-dda5098a7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1874366341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1e0fa50f-ce12-4134-9ab5-9cbd04584fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c488416d8d7418eaff51ad824a408d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:33:37Z,use_quota=True,user_id='9ff7ef99590c4bdeb592373970b395f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf01071-3754-4825-827a-57c9790fa146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bf01071-3754-4825-827a-57c9790fa146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d6ca00-4f2d-451e-a42e-344d9d4cb009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16d6ca00-4f2d-451e-a42e-344d9d4cb009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'volume_name': 'volume-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf15d21-e6a4-4fbc-aba3-799ad094d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf15d21-e6a4-4fbc-aba3-799ad094d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372b3049-3840-4172-9031-56c00e183929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Volume 1e0fa50f-ce12-4134-9ab5-9cbd04584fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'volume_size': 1} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] creating volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] create volume {'name': 'v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'is_clone': False, 'name': 'v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=34,cinder:SELECT=59,cinder:INSERT=6,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372b3049-3840-4172-9031-56c00e183929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009fe8ea-afbe-49a1-996f-8a605e3af584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:33:37 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Volume volume-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe (1e0fa50f-ce12-4134-9ab5-9cbd04584fbe): created successfully Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009fe8ea-afbe-49a1-996f-8a605e3af584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:33:37 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Flow 'volume_create_manager' (10477275-e74b-420f-bf60-cb18a2bcdea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:33:37 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fef1f2c6-5259-47e6-ae77-b61f2369f91b tempest-VolumeRevertTests-1633795360 None] Created volume successfully. Apr 14 00:33:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] create snapshot 4cd44474-2fd1-4d53-b246-3da6a8efd220 for volume 1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:33:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] cloning v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe to s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:33:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] create snapshot s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:33:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_4cd44474-2fd1-4d53-b246-3da6a8efd220'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] create volume s_4cd44474-2fd1-4d53-b246-3da6a8efd220 from snapshot s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:33:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe@s_4cd44474-2fd1-4d53-b246-3da6a8efd220', 'is_clone': True, 'full_name': 'Pool-0/s_4cd44474-2fd1-4d53-b246-3da6a8efd220', 'name': 's_4cd44474-2fd1-4d53-b246-3da6a8efd220'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] volume s_4cd44474-2fd1-4d53-b246-3da6a8efd220 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:33:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-77cfb40a-7102-404f-807e-47169d321315 tempest-VolumeRevertTests-1633795360 None] Create snapshot completed successfully Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-df9d8207-cdec-47c3-8fac-c7d41245bda2 tempest-VolumeRevertTests-1633795360 None] Extend volume 1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) extend_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:401}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-df9d8207-cdec-47c3-8fac-c7d41245bda2 tempest-VolumeRevertTests-1633795360 None] jdss extend volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe to 2147483648 {{(pid=84560) extend_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:160}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df9d8207-cdec-47c3-8fac-c7d41245bda2 tempest-VolumeRevertTests-1633795360 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df9d8207-cdec-47c3-8fac-c7d41245bda2 tempest-VolumeRevertTests-1633795360 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-df9d8207-cdec-47c3-8fac-c7d41245bda2 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:41 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=35,cinder:SELECT=56,cinder:INSERT=4,cinder:DELETE=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:33:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-df9d8207-cdec-47c3-8fac-c7d41245bda2 tempest-VolumeRevertTests-1633795360 None] Extend volume completed successfully. Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Acquiring lock "cinder-4cd44474-2fd1-4d53-b246-3da6a8efd220-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Lock "cinder-4cd44474-2fd1-4d53-b246-3da6a8efd220-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] deleating snapshot s_4cd44474-2fd1-4d53-b246-3da6a8efd220. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] get snapshots for volume s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] get volume s_4cd44474-2fd1-4d53-b246-3da6a8efd220 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe@s_4cd44474-2fd1-4d53-b246-3da6a8efd220', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_4cd44474-2fd1-4d53-b246-3da6a8efd220', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433829', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109069', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14030126003887515338', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'deb33ba78f6d5815', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331484160', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '78335', 'name': 's_4cd44474-2fd1-4d53-b246-3da6a8efd220', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] delete snapshot s_4cd44474-2fd1-4d53-b246-3da6a8efd220 of volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots/s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots/s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots/s_4cd44474-2fd1-4d53-b246-3da6a8efd220 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] snapshot s_4cd44474-2fd1-4d53-b246-3da6a8efd220 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.quota [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Created reservations ['0ab96543-32c8-4b1f-8fa1-54bb4dd0e16c', '8206379c-2ab5-4621-baf5-16e85a269974', '2f2a3467-a211-4e27-8224-4fcc31e09264', 'f685e535-83bf-4bd1-b597-8f82ad392d69'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:44 user cinder-volume[84560]: INFO cinder.volume.manager [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Delete snapshot completed successfully. Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-51c43f3a-e529-457b-a310-6914d7bb4e9b tempest-VolumeRevertTests-1633795360 None] Lock "cinder-4cd44474-2fd1-4d53-b246-3da6a8efd220-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Acquiring lock "cinder-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.coordination [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Lock "cinder-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] remove_export for volume: 1e0fa50f-ce12-4134-9ab5-9cbd04584fbe. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-1874366341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=1e0fa50f-ce12-4134-9ab5-9cbd04584fbe,launched_at=2023-04-14T00:33:38Z,metadata={},migration_status=None,multiattach=False,previous_status='available',project_id='2c488416d8d7418eaff51ad824a408d3',provider_auth='CHAP heGYDrwt nUPmZpsR76tLVc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:37Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:33:44Z,updated_at=2023-04-14T00:33:44Z,use_quota=True,user_id='9ff7ef99590c4bdeb592373970b395f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] detach volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe from target iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/luns/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/luns/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/luns/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/luns/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] failed to remove resource iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe because of JDSS resource v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] delete target: iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] delete target iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] failed to remove resource iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe because of JDSS resource iqn.2010-10.org.openstack:1e0fa50f-ce12-4134-9ab5-9cbd04584fbe DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] deleating volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] get snapshots for volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] get volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433827', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109063', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10179388081559442858', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b67d176b45e2fe8c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331578368', 'san:volume_id': 'b67d176b45e2fe8c267650e18fd76d56ad6556bb', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80718', 'name': 'v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] delete volume:v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] volume v_1e0fa50f-ce12-4134-9ab5-9cbd04584fbe deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.quota [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Created reservations ['69ba5105-2169-4b13-b127-d96aaeed7554', '6eea1e0c-3868-420b-a4ab-ac5e6e44ba10', '5b05880b-b7e3-426e-bc20-3e40ab2fe5fb', '4d909387-5076-426d-bb4f-0cdd554dc7cc'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331660288', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.manager [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Deleted volume successfully. Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-db33611d-5ccb-4262-884e-d15aeb37bd15 tempest-VolumeRevertTests-1633795360 None] Lock "cinder-1e0fa50f-ce12-4134-9ab5-9cbd04584fbe-delete_volume" released by "delete_volume" :: held 2.934s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Acquiring lock "cinder-29480e6a-de46-4d11-b910-737a9695abd8-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Lock "cinder-29480e6a-de46-4d11-b910-737a9695abd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] deleating snapshot s_29480e6a-de46-4d11-b910-737a9695abd8. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] get snapshots for volume s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] get volume s_29480e6a-de46-4d11-b910-737a9695abd8 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250@s_29480e6a-de46-4d11-b910-737a9695abd8', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_29480e6a-de46-4d11-b910-737a9695abd8', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433818', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109049', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10073864203848369789', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3dce4ec687c4c6e3', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331660288', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79445', 'name': 's_29480e6a-de46-4d11-b910-737a9695abd8', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] delete snapshot s_29480e6a-de46-4d11-b910-737a9695abd8 of volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots/s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots/s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots/s_29480e6a-de46-4d11-b910-737a9695abd8 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] snapshot s_29480e6a-de46-4d11-b910-737a9695abd8 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.quota [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Created reservations ['9e160c30-bca2-4955-b931-2f3192fb69d8', 'a00a2e2c-51fe-4e95-92f7-f48c10f50e6e', '36e9d194-cf26-4d02-a5bb-3dc170b0855c', '629c3a18-3c7d-43b1-9842-70ea177372e5'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Delete snapshot completed successfully. Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-26cfea81-799f-47f3-97c2-761d087187a6 tempest-VolumeRevertTests-1633795360 None] Lock "cinder-29480e6a-de46-4d11-b910-737a9695abd8-delete_snapshot" released by "delete_snapshot" :: held 2.003s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Acquiring lock "cinder-ad5b2c57-b71f-40a0-81b4-81907e5f1250-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Lock "cinder-ad5b2c57-b71f-40a0-81b4-81907e5f1250-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] remove_export for volume: ad5b2c57-b71f-40a0-81b4-81907e5f1250. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRevertTests-Volume-125976324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=ad5b2c57-b71f-40a0-81b4-81907e5f1250,launched_at=2023-04-14T00:33:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c488416d8d7418eaff51ad824a408d3',provider_auth='CHAP IbxtCzHk mg04LRtiOBnyfY',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:33:50Z,updated_at=2023-04-14T00:33:50Z,use_quota=True,user_id='9ff7ef99590c4bdeb592373970b395f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] detach volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 from target iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250/luns/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250/luns/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250/luns/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250/luns/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] failed to remove resource iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 because of JDSS resource v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] delete target: iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] delete target iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] failed to remove resource iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 because of JDSS resource iqn.2010-10.org.openstack:ad5b2c57-b71f-40a0-81b4-81907e5f1250 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] deleating volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] get snapshots for volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] get volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433816', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109040', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16940197383635465559', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0b77f2e73149abd1', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331697152', 'san:volume_id': '0b77f2e73149abd151147d13dd48ec7910ca8232', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80536', 'name': 'v_ad5b2c57-b71f-40a0-81b4-81907e5f1250', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] delete volume:v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] volume v_ad5b2c57-b71f-40a0-81b4-81907e5f1250 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.quota [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Created reservations ['a7d943a5-386e-45b9-89d1-6ac15f886f39', '39ac1b9c-3a5d-49b4-a1b1-6ea93265c3c5', '5245bd91-9d78-4321-b269-290dae7cec9b', '9a5421a4-9ecc-4a7d-9558-11a7cca1be17'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:33:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:33:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331779072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:33:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:33:52 user cinder-volume[84560]: DEBUG cinder.manager [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:33:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Deleted volume successfully. Apr 14 00:33:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-dea608e7-1fc0-4f7d-b796-2a7d8cc1a825 tempest-VolumeRevertTests-1633795360 None] Lock "cinder-ad5b2c57-b71f-40a0-81b4-81907e5f1250-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:34:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:DELETE=3,cinder:SELECT=50,cinder:UPDATE=33,cinder:INSERT=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=49,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331779072', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:34:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:34:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] terminate connection for 0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:34:53 user cinder-volume[84560]: INFO cinder.volume.manager [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Terminate volume connection completed successfully. Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Deleting attachment 6ae724da-49f3-455b-a3a2-7986cfb73c5e. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] remove_export for volume: 0f9e1f92-e142-4576-a375-32dc12d96c82. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1571439229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0f9e1f92-e142-4576-a375-32dc12d96c82,launched_at=2023-04-14T00:32:40Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='46777f523af54eecb0e3260f14df7909',provider_auth='CHAP nrgBiqQL VoX2OUdT1EQ46j',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:39Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:34:53Z,use_quota=True,user_id='e5ad76f13b78448887913c4d0bcb16af',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] detach volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 from target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] delete target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] delete target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:34:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:34:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:34:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-728271bc-9cf3-427f-b312-6dd320d229ea req-4b18acf0-0be8-4ae6-94ff-4d086e8e0436 tempest-TestMinimumBasicScenario-598834355 None] target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:35:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331766784', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:35:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:35:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Flow 'volume_create_manager' (2164ac9b-6987-4789-8337-2c6357528983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2834a2-5f39-45a0-81cd-de012405a82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb2834a2-5f39-45a0-81cd-de012405a82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1066481166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b948765c-2d46-4af5-a2ba-3ece06ba2d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46ba54fdcdb45368f457001f26a281b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:35:29Z,use_quota=True,user_id='67248d6b437547918b0cc2b0cdf29536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb55e414-78af-475d-b38f-1b8f5547614f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb55e414-78af-475d-b38f-1b8f5547614f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f97386-cb2b-4516-b8e2-d082bfa6d31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f97386-cb2b-4516-b8e2-d082bfa6d31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'volume_name': 'volume-b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d227ab65-3aa6-4ff6-b7f1-a4fd9bac047a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d227ab65-3aa6-4ff6-b7f1-a4fd9bac047a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3d1e10-3c35-468d-aa51-b21000fca730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:35:28 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Volume b948765c-2d46-4af5-a2ba-3ece06ba2d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'volume_size': 1} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] creating volume v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] create volume {'name': 'v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'is_clone': False, 'name': 'v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3d1e10-3c35-468d-aa51-b21000fca730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:35:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e504dbf8-578e-4dc2-a035-62427bba6089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:35:29 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Volume volume-b948765c-2d46-4af5-a2ba-3ece06ba2d2a (b948765c-2d46-4af5-a2ba-3ece06ba2d2a): created successfully Apr 14 00:35:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e504dbf8-578e-4dc2-a035-62427bba6089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:35:29 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Flow 'volume_create_manager' (2164ac9b-6987-4789-8337-2c6357528983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:35:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f7373429-16f1-4207-bfa6-41fd6c58c39a tempest-ServersNegativeTestJSON-495782531 None] Created volume successfully. Apr 14 00:35:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Acquiring lock "cinder-0f9e1f92-e142-4576-a375-32dc12d96c82-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Lock "cinder-0f9e1f92-e142-4576-a375-32dc12d96c82-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] remove_export for volume: 0f9e1f92-e142-4576-a375-32dc12d96c82. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1571439229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=0f9e1f92-e142-4576-a375-32dc12d96c82,launched_at=2023-04-14T00:32:40Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46777f523af54eecb0e3260f14df7909',provider_auth='CHAP nrgBiqQL VoX2OUdT1EQ46j',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:32:39Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:35:43Z,updated_at=2023-04-14T00:35:43Z,use_quota=True,user_id='e5ad76f13b78448887913c4d0bcb16af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] detach volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 from target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82/luns/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] failed to remove resource iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 because of JDSS resource v_0f9e1f92-e142-4576-a375-32dc12d96c82 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] delete target: iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] delete target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] failed to remove resource iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 because of JDSS resource iqn.2010-10.org.openstack:0f9e1f92-e142-4576-a375-32dc12d96c82 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] deleating volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] get snapshots for volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] get volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_0f9e1f92-e142-4576-a375-32dc12d96c82', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433769', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '108971', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17205365852083298700', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'bf7fb6efc1e8741a', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331684864', 'san:volume_id': 'bf7fb6efc1e8741a0be33f5fac043f1aacf5c090', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80775', 'name': 'v_0f9e1f92-e142-4576-a375-32dc12d96c82', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] delete volume:v_0f9e1f92-e142-4576-a375-32dc12d96c82 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_0f9e1f92-e142-4576-a375-32dc12d96c82 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] volume v_0f9e1f92-e142-4576-a375-32dc12d96c82 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.quota [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Created reservations ['44ac7c20-fb90-4258-94d3-e6b61ad1c1ae', 'd9bf1465-27d9-4a04-a7a3-bc428a221cae', 'c213b6ea-3793-469c-9b93-cd52040d678b', '37d978f2-a458-487e-966e-1fb1ff9f5218'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331815936', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.manager [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:35:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Deleted volume successfully. Apr 14 00:35:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f464d636-6418-40c9-afb1-239eb8b12f88 tempest-TestMinimumBasicScenario-598834355 None] Lock "cinder-0f9e1f92-e142-4576-a375-32dc12d96c82-delete_volume" released by "delete_volume" :: held 5.002s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:35:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:DELETE=2,cinder:UPDATE=8,cinder:INSERT=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331803648', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:36:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:36:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Acquiring lock "cinder-b948765c-2d46-4af5-a2ba-3ece06ba2d2a-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Lock "cinder-b948765c-2d46-4af5-a2ba-3ece06ba2d2a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] remove_export for volume: b948765c-2d46-4af5-a2ba-3ece06ba2d2a. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1066481166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=b948765c-2d46-4af5-a2ba-3ece06ba2d2a,launched_at=2023-04-14T00:35:30Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46ba54fdcdb45368f457001f26a281b',provider_auth='CHAP jGnHcLAX JQwizWpqroGja1',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:35:29Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:36:31Z,updated_at=2023-04-14T00:36:31Z,use_quota=True,user_id='67248d6b437547918b0cc2b0cdf29536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] detach volume v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a from target iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a/luns/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a/luns/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a/luns/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a/luns/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] failed to remove resource iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a because of JDSS resource v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] delete target: iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] delete target iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] failed to remove resource iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a because of JDSS resource iqn.2010-10.org.openstack:b948765c-2d46-4af5-a2ba-3ece06ba2d2a DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] deleating volume v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] get snapshots for volume v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] get volume v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433938', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109104', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6573521375406802630', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '112589e8fac4703c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331803648', 'san:volume_id': '112589e8fac4703c754b3d487d5fe706992ba5e3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80902', 'name': 'v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] delete volume:v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] volume v_b948765c-2d46-4af5-a2ba-3ece06ba2d2a deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.quota [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Created reservations ['b0fe8657-e9b8-4f0c-9314-8ff21832b0bd', '7676d8eb-625d-4494-9d80-c61ce552efef', '7eb84deb-5a5b-4bf4-8892-7a27806011a0', 'b75e0d69-00a1-44a5-82cd-53302c43b249'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331885568', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.manager [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:36:34 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Deleted volume successfully. Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-5d461b4c-73ec-478f-8ed4-8547e2490e4f tempest-ServersNegativeTestJSON-495782531 None] Lock "cinder-b948765c-2d46-4af5-a2ba-3ece06ba2d2a-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Acquiring lock "cinder-6233bd0f-d400-4c8d-9aad-e052a2ae8f21-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.coordination [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Lock "cinder-6233bd0f-d400-4c8d-9aad-e052a2ae8f21-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] remove_export for volume: 6233bd0f-d400-4c8d-9aad-e052a2ae8f21. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2028180304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=6233bd0f-d400-4c8d-9aad-e052a2ae8f21,launched_at=2023-04-14T00:33:27Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e46ba54fdcdb45368f457001f26a281b',provider_auth='CHAP YJRQOuDw byZncj1FUSrheg',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:33:26Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:36:35Z,updated_at=2023-04-14T00:36:35Z,use_quota=True,user_id='67248d6b437547918b0cc2b0cdf29536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] detach volume v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 from target iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21/luns/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21/luns/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21/luns/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21/luns/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] failed to remove resource iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 because of JDSS resource v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] delete target: iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] delete target iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] failed to remove resource iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 because of JDSS resource iqn.2010-10.org.openstack:6233bd0f-d400-4c8d-9aad-e052a2ae8f21 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] deleating volume v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] get snapshots for volume v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] get volume v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681433815', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109039', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '12931399791438400515', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f9f0a00f55fa24c0', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331885568', 'san:volume_id': 'f9f0a00f55fa24c0700d9930acd95829c4fcbcc4', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80894', 'name': 'v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] delete volume:v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] volume v_6233bd0f-d400-4c8d-9aad-e052a2ae8f21 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=22,cinder:UPDATE=12,cinder:INSERT=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.quota [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Created reservations ['60088815-aae2-48df-81b0-8fa3b2086036', '45c07cc8-6c6a-497d-8b10-849d86fa5d85', '2cbc36d0-27dc-4fd8-84fe-ac7a4a0c3825', '46dedec1-af31-4876-aa6a-a5ced27196a4'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:36:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:36:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331979776', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:36:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:36:37 user cinder-volume[84560]: DEBUG cinder.manager [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:36:37 user cinder-volume[84560]: INFO cinder.volume.manager [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Deleted volume successfully. Apr 14 00:36:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-169cbffb-a330-4d10-9ed9-5b663818cea5 tempest-ServersNegativeTestJSON-495782531 None] Lock "cinder-6233bd0f-d400-4c8d-9aad-e052a2ae8f21-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:37:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=34,cinder:UPDATE=17,cinder:DELETE=1,cinder:INSERT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331979776', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:37:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Flow 'volume_create_manager' (17aea4d2-145d-4bc9-83c0-427b9d80849f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184eec1f-d6ee-4317-93af-58a985099d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (184eec1f-d6ee-4317-93af-58a985099d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2023502633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=426a6e54-bb61-425b-8b02-7082b374c998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d636a09e827e4ac9a785f7b686ef5085',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:37:34Z,use_quota=True,user_id='76bd92d398c04db69ea29668c98853ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ceeab8-e4cc-4a39-800a-9086ebefb200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ceeab8-e4cc-4a39-800a-9086ebefb200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bfc95e-1dd6-4dad-9c49-41941287287a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23bfc95e-1dd6-4dad-9c49-41941287287a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426a6e54-bb61-425b-8b02-7082b374c998', 'volume_name': 'volume-426a6e54-bb61-425b-8b02-7082b374c998', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d120a535-8de4-4633-8ccc-094e928a1c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d120a535-8de4-4633-8ccc-094e928a1c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe3a6a7-f3eb-43d3-a8c3-d316b90dacab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:37:33 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Volume 426a6e54-bb61-425b-8b02-7082b374c998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426a6e54-bb61-425b-8b02-7082b374c998', 'volume_size': 1} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] creating volume v_426a6e54-bb61-425b-8b02-7082b374c998. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] create volume {'name': 'v_426a6e54-bb61-425b-8b02-7082b374c998', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998', 'is_clone': False, 'name': 'v_426a6e54-bb61-425b-8b02-7082b374c998'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe3a6a7-f3eb-43d3-a8c3-d316b90dacab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426a6e54-bb61-425b-8b02-7082b374c998', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:37:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49344005-7deb-4893-8fc1-bc64efa8d7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:37:34 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Volume volume-426a6e54-bb61-425b-8b02-7082b374c998 (426a6e54-bb61-425b-8b02-7082b374c998): created successfully Apr 14 00:37:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49344005-7deb-4893-8fc1-bc64efa8d7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:37:34 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Flow 'volume_create_manager' (17aea4d2-145d-4bc9-83c0-427b9d80849f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:37:34 user cinder-volume[84560]: INFO cinder.volume.manager [None req-db73f8f8-4a4f-4022-82b8-8d7853ccd4ed tempest-SnapshotsActionsTest-923850558 None] Created volume successfully. Apr 14 00:37:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:37:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] create snapshot f2527d84-ceb4-40de-bcb7-7c876f5fb425 for volume 426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:37:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] cloning v_426a6e54-bb61-425b-8b02-7082b374c998 to s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:37:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] create snapshot s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:37:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_f2527d84-ceb4-40de-bcb7-7c876f5fb425'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] create volume s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 from snapshot s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_f2527d84-ceb4-40de-bcb7-7c876f5fb425', 'is_clone': True, 'full_name': 'Pool-0/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425', 'name': 's_f2527d84-ceb4-40de-bcb7-7c876f5fb425'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] volume s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:37:37 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f5979ada-0342-4d7f-ad2f-e385da7efbf2 tempest-SnapshotsActionsTest-923850558 None] Create snapshot completed successfully Apr 14 00:37:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] create snapshot 3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 for volume 426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:37:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] cloning v_426a6e54-bb61-425b-8b02-7082b374c998 to s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:37:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] create snapshot s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:37:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] create volume s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 from snapshot s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:37:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47', 'is_clone': True, 'full_name': 'Pool-0/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47', 'name': 's_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] volume s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:37:40 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c645d75b-281a-4cac-93a0-2e48f96f24d6 tempest-SnapshotsActionsTest-923850558 None] Create snapshot completed successfully Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Acquiring lock "cinder-3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] deleating snapshot s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] get snapshots for volume s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] get volume s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434069', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109145', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '18138567765556546517', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '0506b1343ab46b10', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331860992', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81202', 'name': 's_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] delete snapshot s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 of volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] snapshot s_3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:37:42 user cinder-volume[84560]: DEBUG cinder.quota [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Created reservations ['ffabd862-83a0-4937-83b5-0449faff0f0f', 'ced2a5a8-3cc5-4d1b-9cd2-538215152edc', 'b1c82159-aa51-4634-873e-40861536abe4', 'd791a9cb-7a78-4653-8370-603146f38856'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:37:42 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Delete snapshot completed successfully. Apr 14 00:37:42 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d416139d-46b2-4821-9b6c-0dffc471d931 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-3d0a02e7-fa94-4acc-9c4a-3b3e0d790b47-delete_snapshot" released by "delete_snapshot" :: held 1.999s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:37:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] create snapshot 29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 for volume 426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:37:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] cloning v_426a6e54-bb61-425b-8b02-7082b374c998 to s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:37:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] create snapshot s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:37:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] create volume s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 from snapshot s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:37:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1', 'is_clone': True, 'full_name': 'Pool-0/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1', 'name': 's_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] volume s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:37:45 user cinder-volume[84560]: INFO cinder.volume.manager [None req-31b29b5a-b006-4665-86f2-4dd3f4bd0b2c tempest-SnapshotsActionsTest-923850558 None] Create snapshot completed successfully Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Acquiring lock "cinder-29a44f8a-806d-4291-8a5b-1fc1ba8b22b1-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-29a44f8a-806d-4291-8a5b-1fc1ba8b22b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] deleating snapshot s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] get snapshots for volume s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] get volume s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434074', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109155', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14696868696789166417', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '086b1e1d02fa9602', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331467776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81212', 'name': 's_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] delete snapshot s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 of volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] snapshot s_29a44f8a-806d-4291-8a5b-1fc1ba8b22b1 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.quota [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Created reservations ['c3b28e3f-e4c4-4c32-85dd-5e6a64992c4a', '3d900097-a3f4-4625-aa0f-2e437848d867', 'b6c9d6de-6e69-4f0a-8b80-185869e35f6c', 'e56d6ead-0afa-40eb-ba41-ef47174c9dc2'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:37:47 user cinder-volume[84560]: INFO cinder.volume.manager [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Delete snapshot completed successfully. Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-d1c911a9-936f-447d-bf70-09b90d478cf5 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-29a44f8a-806d-4291-8a5b-1fc1ba8b22b1-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] create snapshot c74745ba-9344-40dc-aaba-532a6c5f7f23 for volume 426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] cloning v_426a6e54-bb61-425b-8b02-7082b374c998 to s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] create snapshot s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_c74745ba-9344-40dc-aaba-532a6c5f7f23'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] create volume s_c74745ba-9344-40dc-aaba-532a6c5f7f23 from snapshot s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_c74745ba-9344-40dc-aaba-532a6c5f7f23', 'is_clone': True, 'full_name': 'Pool-0/s_c74745ba-9344-40dc-aaba-532a6c5f7f23', 'name': 's_c74745ba-9344-40dc-aaba-532a6c5f7f23'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] volume s_c74745ba-9344-40dc-aaba-532a6c5f7f23 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:37:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c291adee-3b6b-4f83-adb7-489845c35cfe tempest-SnapshotsActionsTest-923850558 None] Create snapshot completed successfully Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Acquiring lock "cinder-c74745ba-9344-40dc-aaba-532a6c5f7f23-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-c74745ba-9344-40dc-aaba-532a6c5f7f23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] deleating snapshot s_c74745ba-9344-40dc-aaba-532a6c5f7f23. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] get snapshots for volume s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] get volume s_c74745ba-9344-40dc-aaba-532a6c5f7f23 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_c74745ba-9344-40dc-aaba-532a6c5f7f23', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_c74745ba-9344-40dc-aaba-532a6c5f7f23', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434078', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109165', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '13921471837637814826', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '63c35d63207e2714', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331467776', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81232', 'name': 's_c74745ba-9344-40dc-aaba-532a6c5f7f23', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] delete snapshot s_c74745ba-9344-40dc-aaba-532a6c5f7f23 of volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_c74745ba-9344-40dc-aaba-532a6c5f7f23 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] snapshot s_c74745ba-9344-40dc-aaba-532a6c5f7f23 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.quota [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Created reservations ['4db1c81e-e1f7-4f4d-9b1b-cd4e3f13ff50', '56458674-a847-4d9e-8c84-321515dd2b15', 'b5b1173e-2258-42f6-8618-031bf91288a8', 'e80bb626-bd49-489b-b1e4-3cbd46127d23'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:37:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Delete snapshot completed successfully. Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3a1429d0-b942-4393-af89-dd7076ea0185 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-c74745ba-9344-40dc-aaba-532a6c5f7f23-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] create snapshot 2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 for volume 426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] cloning v_426a6e54-bb61-425b-8b02-7082b374c998 to s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] create snapshot s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] create volume s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 from snapshot s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:37:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:53 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175', 'is_clone': True, 'full_name': 'Pool-0/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175', 'name': 's_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] volume s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:37:54 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1c37dbf9-55ac-47ed-965f-0920e149e4a6 tempest-SnapshotsActionsTest-923850558 None] Create snapshot completed successfully Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Acquiring lock "cinder-2c0cc2f5-e64f-49ec-8dac-988d1f0f8175-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-2c0cc2f5-e64f-49ec-8dac-988d1f0f8175-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] deleating snapshot s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] get snapshots for volume s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] get volume s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434083', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109175', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8405822814565025869', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3676334de9b87a9b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331394048', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80423', 'name': 's_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] delete snapshot s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 of volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] snapshot s_2c0cc2f5-e64f-49ec-8dac-988d1f0f8175 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:37:56 user cinder-volume[84560]: DEBUG cinder.quota [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Created reservations ['5ba63d3d-e974-42b0-a591-f6d9d050338f', 'b7ae69ca-706a-4fae-a119-27bb8cbc724c', 'a971706e-610d-4405-8612-91453d19eb83', '9c6482bc-514c-4d4c-8b0d-3805b5da7697'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:37:56 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Delete snapshot completed successfully. Apr 14 00:37:56 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b27d6d46-9ce1-4283-83d7-4d89ed723411 tempest-SnapshotsActionsTest-9752034 None] Lock "cinder-2c0cc2f5-e64f-49ec-8dac-988d1f0f8175-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Acquiring lock "cinder-f2527d84-ceb4-40de-bcb7-7c876f5fb425-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Lock "cinder-f2527d84-ceb4-40de-bcb7-7c876f5fb425-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] deleating snapshot s_f2527d84-ceb4-40de-bcb7-7c876f5fb425. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] get snapshots for volume s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] get volume s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998@s_f2527d84-ceb4-40de-bcb7-7c876f5fb425', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434066', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109139', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '7680866256249387263', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '12b761256f437e69', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331443200', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81186', 'name': 's_f2527d84-ceb4-40de-bcb7-7c876f5fb425', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] delete snapshot s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 of volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:37:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots/s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] snapshot s_f2527d84-ceb4-40de-bcb7-7c876f5fb425 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:38:00 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=63,cinder:UPDATE=30,cinder:DELETE=2,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:00 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=60,cinder:UPDATE=26,cinder:DELETE=3,cinder:INSERT=11 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:00 user cinder-volume[84560]: DEBUG cinder.quota [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Created reservations ['16db5548-ad6f-4b55-9ea3-fa31b6d49cf8', '3c0ee1c8-6211-46e0-acb1-4591cb1651ff', '0e2d3c75-d4ea-46a2-94a7-d6dae4669841', '2415e94a-c598-4967-8962-4c772aef489a'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:38:00 user cinder-volume[84560]: INFO cinder.volume.manager [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Delete snapshot completed successfully. Apr 14 00:38:00 user cinder-volume[84560]: DEBUG cinder.coordination [None req-aef9d557-832e-4968-9817-9ef4cf173cad tempest-SnapshotsActionsTest-923850558 None] Lock "cinder-f2527d84-ceb4-40de-bcb7-7c876f5fb425-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Acquiring lock "cinder-426a6e54-bb61-425b-8b02-7082b374c998-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Lock "cinder-426a6e54-bb61-425b-8b02-7082b374c998-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] remove_export for volume: 426a6e54-bb61-425b-8b02-7082b374c998. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2023502633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=426a6e54-bb61-425b-8b02-7082b374c998,launched_at=2023-04-14T00:37:35Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d636a09e827e4ac9a785f7b686ef5085',provider_auth='CHAP lBhoVXTJ PBwYDiIH3xoZut',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:37:34Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:38:01Z,updated_at=2023-04-14T00:38:01Z,use_quota=True,user_id='76bd92d398c04db69ea29668c98853ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] detach volume v_426a6e54-bb61-425b-8b02-7082b374c998 from target iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998/luns/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998/luns/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998/luns/v_426a6e54-bb61-425b-8b02-7082b374c998'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998/luns/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] failed to remove resource iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 because of JDSS resource v_426a6e54-bb61-425b-8b02-7082b374c998 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] delete target: iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] delete target iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] failed to remove resource iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 because of JDSS resource iqn.2010-10.org.openstack:426a6e54-bb61-425b-8b02-7082b374c998 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] deleating volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] get snapshots for volume v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] get volume v_426a6e54-bb61-425b-8b02-7082b374c998 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_426a6e54-bb61-425b-8b02-7082b374c998', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434063', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109133', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '6412510601112841024', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '158b6b03549679cf', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331480064', 'san:volume_id': '158b6b03549679cf541b2fba4ea85343f23bdbd8', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80918', 'name': 'v_426a6e54-bb61-425b-8b02-7082b374c998', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] delete volume:v_426a6e54-bb61-425b-8b02-7082b374c998 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_426a6e54-bb61-425b-8b02-7082b374c998 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] volume v_426a6e54-bb61-425b-8b02-7082b374c998 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.quota [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Created reservations ['8fcfc34d-c1cb-4112-b7ad-eada2a5a0eef', '0244bed1-44a5-40bd-9c78-e777492a2e88', '3c5ebf1d-efb9-49cc-b407-e1e0534fc840', '87cfe6e6-eacd-4b96-8b1d-0b770119fb07'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331561984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:38:04 user cinder-volume[84560]: DEBUG cinder.manager [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:38:04 user cinder-volume[84560]: INFO cinder.volume.manager [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Deleted volume successfully. Apr 14 00:38:04 user cinder-volume[84560]: DEBUG cinder.coordination [None req-c207668d-027c-4b13-8bd5-78efedcfd8d5 tempest-SnapshotsActionsTest-923850558 None] Lock "cinder-426a6e54-bb61-425b-8b02-7082b374c998-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Flow 'volume_create_manager' (be3fe314-61d6-45de-9098-1ae56adee549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8c971f-f8b5-42a7-bfb5-3b2a2e17e1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8c971f-f8b5-42a7-bfb5-3b2a2e17e1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-130564172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=35c96fe1-8e83-4ecc-964b-b87ef2610f1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2922d7427304f999c13754c22190d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:38:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:38:06Z,use_quota=True,user_id='885aeb62eaa04a728abdc55e03838951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577faca0-4162-403f-8f38-d2ce664df400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (577faca0-4162-403f-8f38-d2ce664df400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35acd9d-8284-43b2-92b1-9067df5a36e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35acd9d-8284-43b2-92b1-9067df5a36e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'volume_name': 'volume-35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'volume_size': 2}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e3c137-238e-4620-bd7c-e3d121488540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e3c137-238e-4620-bd7c-e3d121488540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee16ee5-1150-442a-bec8-3296a500003b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:06 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Volume 35c96fe1-8e83-4ecc-964b-b87ef2610f1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'volume_size': 2} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] creating volume v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] create volume {'name': 'v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'size': '2147483648', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'is_clone': False, 'name': 'v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee16ee5-1150-442a-bec8-3296a500003b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'volume_size': 2}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55efaaa-f98a-4f76-9e43-35ec84a1a2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:07 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Volume volume-35c96fe1-8e83-4ecc-964b-b87ef2610f1b (35c96fe1-8e83-4ecc-964b-b87ef2610f1b): created successfully Apr 14 00:38:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55efaaa-f98a-4f76-9e43-35ec84a1a2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Flow 'volume_create_manager' (be3fe314-61d6-45de-9098-1ae56adee549) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:38:07 user cinder-volume[84560]: INFO cinder.volume.manager [None req-923a67eb-4bcc-4d5e-afcd-05643f23c508 tempest-VolumesCloneNegativeTest-1233954179 None] Created volume successfully. Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.coordination [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Acquiring lock "cinder-35c96fe1-8e83-4ecc-964b-b87ef2610f1b-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.coordination [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Lock "cinder-35c96fe1-8e83-4ecc-964b-b87ef2610f1b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] remove_export for volume: 35c96fe1-8e83-4ecc-964b-b87ef2610f1b. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-130564172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=35c96fe1-8e83-4ecc-964b-b87ef2610f1b,launched_at=2023-04-14T00:38:07Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2922d7427304f999c13754c22190d8a',provider_auth='CHAP WZUJBaLC xltkDidpHmWQrj',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:38:06Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:38:09Z,updated_at=2023-04-14T00:38:09Z,use_quota=True,user_id='885aeb62eaa04a728abdc55e03838951',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] detach volume v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b from target iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b/luns/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b/luns/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b/luns/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b/luns/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] failed to remove resource iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b because of JDSS resource v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] delete target: iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] delete target iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] failed to remove resource iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b because of JDSS resource iqn.2010-10.org.openstack:35c96fe1-8e83-4ecc-964b-b87ef2610f1b DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] deleating volume v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] get snapshots for volume v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] get volume v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434096', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '2147483648', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109188', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1347113404323522887', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ead33400e1f1691e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331480064', 'san:volume_id': 'ead33400e1f1691e312bcc11d8f8efc9e9a4565c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80941', 'name': 'v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] delete volume:v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] volume v_35c96fe1-8e83-4ecc-964b-b87ef2610f1b deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.quota [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Created reservations ['1b4d61cb-3814-4cb9-b3e0-2b305e2e331a', '1fdc104c-d065-4e86-b4f9-69406532cc06', '2e874297-cad8-449c-a876-0c4be4f0a843', 'c2c964a9-8e65-448e-9b13-930d12b497ac'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:10 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331561984', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:38:11 user cinder-volume[84560]: DEBUG cinder.manager [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:38:11 user cinder-volume[84560]: INFO cinder.volume.manager [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Deleted volume successfully. Apr 14 00:38:11 user cinder-volume[84560]: DEBUG cinder.coordination [None req-617ea95e-93c2-4a6c-a4b5-9d24fed32561 tempest-VolumesCloneNegativeTest-1233954179 None] Lock "cinder-35c96fe1-8e83-4ecc-964b-b87ef2610f1b-delete_volume" released by "delete_volume" :: held 2.810s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:38:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:38:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:38:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:38:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331549696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:38:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=36,cinder:UPDATE=26,cinder:INSERT=3,cinder:DELETE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=40,cinder:INSERT=9,cinder:UPDATE=24 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Flow 'volume_create_manager' (a8c2dc07-3ea4-483e-8003-432747822722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e25c82-0806-4c02-a9b9-77763ed898ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e25c82-0806-4c02-a9b9-77763ed898ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-16042356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17f3af17-ec13-4449-90ee-4b4f2375cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46777f523af54eecb0e3260f14df7909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:38:32Z,use_quota=True,user_id='e5ad76f13b78448887913c4d0bcb16af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff23c03-0852-46db-ba19-18389ce3d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff23c03-0852-46db-ba19-18389ce3d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa746bba-8ec2-4d7d-894b-b5975c8baa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa746bba-8ec2-4d7d-894b-b5975c8baa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f3af17-ec13-4449-90ee-4b4f2375cd14', 'volume_name': 'volume-17f3af17-ec13-4449-90ee-4b4f2375cd14', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e640a7db-0770-4a9d-a3da-68ced3934d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e640a7db-0770-4a9d-a3da-68ced3934d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e3f858-a5cd-411a-8cc4-d2fc3ac3c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:32 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Volume 17f3af17-ec13-4449-90ee-4b4f2375cd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f3af17-ec13-4449-90ee-4b4f2375cd14', 'volume_size': 1} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] creating volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] create volume {'name': 'v_17f3af17-ec13-4449-90ee-4b4f2375cd14', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_17f3af17-ec13-4449-90ee-4b4f2375cd14', 'is_clone': False, 'name': 'v_17f3af17-ec13-4449-90ee-4b4f2375cd14'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9e3f858-a5cd-411a-8cc4-d2fc3ac3c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f3af17-ec13-4449-90ee-4b4f2375cd14', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3681351-c9c2-4a48-9da3-a2d8b8257c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:38:33 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Volume volume-17f3af17-ec13-4449-90ee-4b4f2375cd14 (17f3af17-ec13-4449-90ee-4b4f2375cd14): created successfully Apr 14 00:38:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3681351-c9c2-4a48-9da3-a2d8b8257c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:38:33 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Flow 'volume_create_manager' (a8c2dc07-3ea4-483e-8003-432747822722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:38:33 user cinder-volume[84560]: INFO cinder.volume.manager [None req-79aac78b-6ebe-45f5-9a59-1bc867dba1c8 tempest-TestMinimumBasicScenario-598834355 None] Created volume successfully. Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] create export for volume: 17f3af17-ec13-4449-90ee-4b4f2375cd14. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] ensure volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] check if targe iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] create target and attach volume 17f3af17-ec13-4449-90ee-4b4f2375cd14 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] create target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] atach volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 to target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:38:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6464663733356534', 'lun': 0, 'mode': 'wt', 'name': 'v_17f3af17-ec13-4449-90ee-4b4f2375cd14', 'prod_id': 'Storage', 'scsi_id': 'ddf735e48de2d51d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] add credentails to target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 201, 'error': None, 'data': {'name': 'OWCVLeKa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] initialize_connection for 17f3af17-ec13-4449-90ee-4b4f2375cd14 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:38:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OWCVLeKa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '060be45f-01c0-469c-b566-550c166434d0'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:38:39 user cinder-volume[84560]: INFO cinder.volume.manager [req-88377e18-ebd9-4f45-9991-112fe4b62705 req-3dae840d-322a-4dec-abb5-8fe35bc3f51e tempest-TestMinimumBasicScenario-598834355 None] attachment_update completed successfully. Apr 14 00:39:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:39:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:39:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:39:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:39:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:39:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331430912', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:39:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:39:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:39:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=4 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:39:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:40:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:40:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:40:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:40:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:40:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331443200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:40:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:40:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:40:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] terminate connection for 17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:40:40 user cinder-volume[84560]: INFO cinder.volume.manager [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Terminate volume connection completed successfully. Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Deleting attachment 060be45f-01c0-469c-b566-550c166434d0. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] remove_export for volume: 17f3af17-ec13-4449-90ee-4b4f2375cd14. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-16042356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17f3af17-ec13-4449-90ee-4b4f2375cd14,launched_at=2023-04-14T00:38:34Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='46777f523af54eecb0e3260f14df7909',provider_auth='CHAP OWCVLeKa j12RUvFOSmfN6G',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:38:32Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T00:40:39Z,use_quota=True,user_id='e5ad76f13b78448887913c4d0bcb16af',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] detach volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 from target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] delete target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] delete target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:40:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:40:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:40:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-07bd6d89-37e6-4f8d-a7d4-2f6e998da520 req-36054e85-5c1d-4d6c-9ef6-6d34a80562d7 tempest-TestMinimumBasicScenario-598834355 None] target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:40:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331443200', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:41:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Acquiring lock "cinder-17f3af17-ec13-4449-90ee-4b4f2375cd14-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Lock "cinder-17f3af17-ec13-4449-90ee-4b4f2375cd14-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] remove_export for volume: 17f3af17-ec13-4449-90ee-4b4f2375cd14. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-16042356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=17f3af17-ec13-4449-90ee-4b4f2375cd14,launched_at=2023-04-14T00:38:34Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46777f523af54eecb0e3260f14df7909',provider_auth='CHAP OWCVLeKa j12RUvFOSmfN6G',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:38:32Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:41:30Z,updated_at=2023-04-14T00:41:30Z,use_quota=True,user_id='e5ad76f13b78448887913c4d0bcb16af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] detach volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 from target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14/luns/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] failed to remove resource iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 because of JDSS resource v_17f3af17-ec13-4449-90ee-4b4f2375cd14 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] delete target: iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] delete target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] failed to remove resource iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 because of JDSS resource iqn.2010-10.org.openstack:17f3af17-ec13-4449-90ee-4b4f2375cd14 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] deleating volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] get snapshots for volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] get volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_17f3af17-ec13-4449-90ee-4b4f2375cd14', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434122', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '57344', 'sharesmb': None, 'createtxg': '109197', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8671199670588564212', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '57344', 'logicalused': '28672', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'ddf735e48de2d51d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331443200', 'san:volume_id': 'ddf735e48de2d51d885d2bca07918d701d5cfbe3', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.00', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '57344', 'objsetid': '80446', 'name': 'v_17f3af17-ec13-4449-90ee-4b4f2375cd14', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '57344', 'logicalreferenced': '28672', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] delete volume:v_17f3af17-ec13-4449-90ee-4b4f2375cd14 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_17f3af17-ec13-4449-90ee-4b4f2375cd14 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] volume v_17f3af17-ec13-4449-90ee-4b4f2375cd14 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.quota [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Created reservations ['817b1cc6-4bbf-4365-a9da-e1dcdec61f2d', 'b4ac7fd5-a5b2-43fb-88b7-e701c5fa49ba', '13120e7d-00c3-4da7-80df-65b50983f1a8', '0fcda9bd-e5ec-454b-855b-94c554a87cc7'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:41:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:41:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331906048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:41:33 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:41:33 user cinder-volume[84560]: DEBUG cinder.manager [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:41:33 user cinder-volume[84560]: INFO cinder.volume.manager [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Deleted volume successfully. Apr 14 00:41:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-98608d4b-5510-4773-ba35-bc8ac280aa83 tempest-TestMinimumBasicScenario-598834355 None] Lock "cinder-17f3af17-ec13-4449-90ee-4b4f2375cd14-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:41:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=9 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:41:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=16,cinder:UPDATE=11,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:42:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:42:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:42:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331906048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:42:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:42:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (1ecd1374-8bce-4c75-97a2-a02c5747127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa656f72-ef14-48d2-837f-7e8907ee7949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa656f72-ef14-48d2-837f-7e8907ee7949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2127728341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e3a44e8d-c2c2-419e-afee-01b2d93e7f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:42:48Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb26c8ff-948c-4f71-874f-418004c9b900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb26c8ff-948c-4f71-874f-418004c9b900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ac8e82-e828-4132-a9e6-66b9c42956c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ac8e82-e828-4132-a9e6-66b9c42956c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'volume_name': 'volume-e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d8a20e-d3c6-4755-81e8-a2780a4f02cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d8a20e-d3c6-4755-81e8-a2780a4f02cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354b04b7-29ea-495c-83ea-b1efa3f0f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:47 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Volume e3a44e8d-c2c2-419e-afee-01b2d93e7f63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Cloning e3a44e8d-c2c2-419e-afee-01b2d93e7f63 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 42, 47, 889297)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.coordination [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.033s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 42, 47, 912479)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] create snapshot v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] create volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 from snapshot v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:42:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'is_clone': True, 'full_name': 'Pool-0/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'name': 'v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] get volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434378', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '109258', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17157569430783607460', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '14dd283e03525d53', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331869184', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80200', 'name': 'v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Marking volume e3a44e8d-c2c2-419e-afee-01b2d93e7f63 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to e3a44e8d-c2c2-419e-afee-01b2d93e7f63. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Creating volume glance metadata for volume e3a44e8d-c2c2-419e-afee-01b2d93e7f63 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (354b04b7-29ea-495c-83ea-b1efa3f0f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4adfc34-ae57-4ab0-8d99-b6f68c1313c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:49 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Volume volume-e3a44e8d-c2c2-419e-afee-01b2d93e7f63 (e3a44e8d-c2c2-419e-afee-01b2d93e7f63): created successfully Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4adfc34-ae57-4ab0-8d99-b6f68c1313c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (1ecd1374-8bce-4c75-97a2-a02c5747127a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:42:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8c6217e2-1f21-4b01-9feb-ace56b282c23 tempest-TestVolumeBootPattern-260409128 None] Created volume successfully. Apr 14 00:42:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] create snapshot a7e35933-c830-4d32-abde-a95c31b23f63 for volume e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:42:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] cloning v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 to s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:42:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] create snapshot s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:42:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_a7e35933-c830-4d32-abde-a95c31b23f63'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] create volume s_a7e35933-c830-4d32-abde-a95c31b23f63 from snapshot s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63@s_a7e35933-c830-4d32-abde-a95c31b23f63', 'is_clone': True, 'full_name': 'Pool-0/s_a7e35933-c830-4d32-abde-a95c31b23f63', 'name': 's_a7e35933-c830-4d32-abde-a95c31b23f63'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:52 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] volume s_a7e35933-c830-4d32-abde-a95c31b23f63 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:42:52 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3bba1bc4-b9cf-436c-af75-25d24599e4fd tempest-TestVolumeBootPattern-260409128 None] Create snapshot completed successfully Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (4be3ec12-8674-4490-a18e-1999a7e3dac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64e2f2-2f31-40f2-b6a5-e60fba952984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c64e2f2-2f31-40f2-b6a5-e60fba952984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:42:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ddd1cc0-8674-458e-bd7e-2479493c1fd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a7e35933-c830-4d32-abde-a95c31b23f63,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:42:56Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c145947-2f68-49af-b98c-366d4b7eb554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c145947-2f68-49af-b98c-366d4b7eb554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bb4c96-2477-4c93-9bd5-1bbc60f4b003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bb4c96-2477-4c93-9bd5-1bbc60f4b003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'volume_name': 'volume-9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'volume_size': 1, 'snapshot_id': 'a7e35933-c830-4d32-abde-a95c31b23f63'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e85c27-98af-49c5-8ccd-04a4462278ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09e85c27-98af-49c5-8ccd-04a4462278ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f99335f-2774-4ca9-82d6-f5bc37b60589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:55 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Volume 9ddd1cc0-8674-458e-bd7e-2479493c1fd3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'volume_size': 1, 'snapshot_id': 'a7e35933-c830-4d32-abde-a95c31b23f63'} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] create volume 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 from snapshot a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] cloning s_a7e35933-c830-4d32-abde-a95c31b23f63 to v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] create snapshot v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=41,cinder:UPDATE=8,cinder:INSERT=24,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:42:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] create volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 from snapshot v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:42:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_a7e35933-c830-4d32-abde-a95c31b23f63@v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'is_clone': True, 'full_name': 'Pool-0/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'name': 'v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] get volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_a7e35933-c830-4d32-abde-a95c31b23f63@v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434386', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '109270', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16232537672898054272', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '405a2a1c7c0a1056', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331832320', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81055', 'name': 'v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Marking volume 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Copying metadata from snapshot a7e35933-c830-4d32-abde-a95c31b23f63 to 9ddd1cc0-8674-458e-bd7e-2479493c1fd3. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f99335f-2774-4ca9-82d6-f5bc37b60589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'volume_size': 1, 'snapshot_id': 'a7e35933-c830-4d32-abde-a95c31b23f63'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4565ed95-275e-43cf-8e07-50584d8bc129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:42:57 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Volume volume-9ddd1cc0-8674-458e-bd7e-2479493c1fd3 (9ddd1cc0-8674-458e-bd7e-2479493c1fd3): created successfully Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4565ed95-275e-43cf-8e07-50584d8bc129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:42:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (4be3ec12-8674-4490-a18e-1999a7e3dac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:42:57 user cinder-volume[84560]: INFO cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-2e4ad5be-41a6-4c3c-978d-8194f4546b6d tempest-TestVolumeBootPattern-260409128 None] Created volume successfully. Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] create export for volume: 9ddd1cc0-8674-458e-bd7e-2479493c1fd3. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] ensure volume 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] check if targe iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] create target and attach volume 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] create target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:43:01 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:43:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:43:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] atach volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 to target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:43:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:43:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:43:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3430356132613163', 'lun': 0, 'mode': 'wt', 'name': 'v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'prod_id': 'Storage', 'scsi_id': '405a2a1c7c0a1056'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:43:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] add credentails to target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:43:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:43:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:43:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'name': 'QXWvJOjm'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:43:05 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] initialize_connection for 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:43:05 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QXWvJOjm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '88806eb1-d65c-4041-acc1-55d42ba956bc'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:43:05 user cinder-volume[84560]: INFO cinder.volume.manager [req-40329473-01b7-49ac-b0b8-3166ff7fb72c req-7985c7a3-9e43-4e66-b2e8-bc2c09457de9 tempest-TestVolumeBootPattern-260409128 None] attachment_update completed successfully. Apr 14 00:43:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:43:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:43:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:43:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:43:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:43:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331680768', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:43:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:43:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:43:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=4,cinder:SELECT=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:43:45 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:44:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:44:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:44:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321620992', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:44:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:44:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] terminate connection for 9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:44:47 user cinder-volume[84560]: INFO cinder.volume.manager [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Terminate volume connection completed successfully. Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Deleting attachment 88806eb1-d65c-4041-acc1-55d42ba956bc. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 9ddd1cc0-8674-458e-bd7e-2479493c1fd3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:42:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ddd1cc0-8674-458e-bd7e-2479493c1fd3,launched_at=2023-04-14T00:42:58Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP QXWvJOjm sSBAr4QYEZNTlO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:42:56Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=a7e35933-c830-4d32-abde-a95c31b23f63,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:43:05Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] detach volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 from target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:47 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-239b644f-d1c3-483b-8559-5a741347a277 tempest-TestVolumeBootPattern-260409128 None] target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.coordination [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-9ddd1cc0-8674-458e-bd7e-2479493c1fd3-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.coordination [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-9ddd1cc0-8674-458e-bd7e-2479493c1fd3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 9ddd1cc0-8674-458e-bd7e-2479493c1fd3. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:42:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=9ddd1cc0-8674-458e-bd7e-2479493c1fd3,launched_at=2023-04-14T00:42:58Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP QXWvJOjm sSBAr4QYEZNTlO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:42:56Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=a7e35933-c830-4d32-abde-a95c31b23f63,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:44:48Z,updated_at=2023-04-14T00:44:48Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] detach volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 from target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3/luns/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 because of JDSS resource v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 because of JDSS resource iqn.2010-10.org.openstack:9ddd1cc0-8674-458e-bd7e-2479493c1fd3 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] deleating volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] get volume v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_a7e35933-c830-4d32-abde-a95c31b23f63@v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434386', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26103808', 'sharesmb': None, 'createtxg': '109270', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16232537672898054272', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10125312', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': '405a2a1c7c0a1056', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321608704', 'san:volume_id': '405a2a1c7c0a105655d333507942fe3979fabbc7', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10125312', 'objsetid': '81055', 'name': 'v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10125312', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] delete snapshot v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 of volume s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots/v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] snapshot v_9ddd1cc0-8674-458e-bd7e-2479493c1fd3 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.quota [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Created reservations ['b5d2fbb2-a856-4207-9d34-f27bf19a88fc', 'e1877aee-98ae-4f06-af76-6debd7c6c30d', '99c0bc83-7a49-46d4-a296-8b9f4f32c62f', '2f0f631c-bef3-48da-813d-46f01eabbcf5'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331795456', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.manager [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:44:50 user cinder-volume[84560]: INFO cinder.volume.manager [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Deleted volume successfully. Apr 14 00:44:50 user cinder-volume[84560]: DEBUG cinder.coordination [req-3b32a642-3277-4b90-b499-daf6d37f74d2 req-5e55d61c-1d47-4d4e-b4d9-b2d181243c67 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-9ddd1cc0-8674-458e-bd7e-2479493c1fd3-delete_volume" released by "delete_volume" :: held 2.742s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:45:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=16,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:45:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:45:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:45:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331807744', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:45:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:45:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:25 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-a7e35933-c830-4d32-abde-a95c31b23f63-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:45:35 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-a7e35933-c830-4d32-abde-a95c31b23f63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:45:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] deleating snapshot s_a7e35933-c830-4d32-abde-a95c31b23f63. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:45:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:45:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] get volume s_a7e35933-c830-4d32-abde-a95c31b23f63 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63@s_a7e35933-c830-4d32-abde-a95c31b23f63', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_a7e35933-c830-4d32-abde-a95c31b23f63', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434381', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '109264', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '3318270207187877036', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'f4ec3405638ec102', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331795456', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81039', 'name': 's_a7e35933-c830-4d32-abde-a95c31b23f63', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] delete snapshot s_a7e35933-c830-4d32-abde-a95c31b23f63 of volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots/s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots/s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots/s_a7e35933-c830-4d32-abde-a95c31b23f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] snapshot s_a7e35933-c830-4d32-abde-a95c31b23f63 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:45:37 user cinder-volume[84560]: DEBUG cinder.quota [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Created reservations ['dea615e8-c813-4d21-ab35-0cb0d72f7b40', 'f989f8a5-1efc-4521-9108-a7d548699639', 'dcb4b762-43f8-4654-85ec-fd0b8fa90bff', '40ff942a-4e50-47be-9a2b-b1ac6dd09389'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:45:37 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Delete snapshot completed successfully. Apr 14 00:45:37 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f4b842cf-e3b9-4142-b6ac-af048158521e tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-a7e35933-c830-4d32-abde-a95c31b23f63-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-e3a44e8d-c2c2-419e-afee-01b2d93e7f63-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-e3a44e8d-c2c2-419e-afee-01b2d93e7f63-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: e3a44e8d-c2c2-419e-afee-01b2d93e7f63. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-2127728341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=e3a44e8d-c2c2-419e-afee-01b2d93e7f63,launched_at=2023-04-14T00:42:50Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP FeKPWJfU SHmZpvsRgUTnYl',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:42:48Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:45:39Z,updated_at=2023-04-14T00:45:39Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] detach volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 from target iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63/luns/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63/luns/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63/luns/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63/luns/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 because of JDSS resource v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 because of JDSS resource iqn.2010-10.org.openstack:e3a44e8d-c2c2-419e-afee-01b2d93e7f63 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] deleating volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] get volume v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434378', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '109258', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17157569430783607460', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '14dd283e03525d53', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331832320', 'san:volume_id': '14dd283e03525d533f3e176d95971201cd7c9a8a', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80200', 'name': 'v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '0', 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] delete snapshot v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] snapshot v_e3a44e8d-c2c2-419e-afee-01b2d93e7f63 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.quota [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Created reservations ['3e8577a8-e792-44af-b225-f241a54df917', '5f25eaf7-f307-43d3-80fd-cb73b99e5d6f', '06c80801-5c41-45cf-ae92-81f794571430', 'a577d33f-fcf3-4c7a-a95f-84e912756175'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331893760', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.manager [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:45:41 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Deleted volume successfully. Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2118494c-1810-4131-89ab-a5689ce90d9a tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-e3a44e8d-c2c2-419e-afee-01b2d93e7f63-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (007c7136-65ca-4229-a89d-d6c23f625612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9001f4e6-39fa-4998-95cd-3b7d0fd84dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9001f4e6-39fa-4998-95cd-3b7d0fd84dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-210590047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=12bc0a58-041c-488e-a961-6c37f530e1b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:45:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:45:41Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b90cec7-b301-4b7b-ace6-65833f4e7053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b90cec7-b301-4b7b-ace6-65833f4e7053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7c7bb3-2c68-481b-b79a-855ad6509524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de7c7bb3-2c68-481b-b79a-855ad6509524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12bc0a58-041c-488e-a961-6c37f530e1b9', 'volume_name': 'volume-12bc0a58-041c-488e-a961-6c37f530e1b9', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a21779-5235-4f1f-b0bc-e9aa79f0d28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a21779-5235-4f1f-b0bc-e9aa79f0d28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2249a5a8-cb12-4dc2-af16-8cc6c7ad9a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:45:41 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Volume 12bc0a58-041c-488e-a961-6c37f530e1b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12bc0a58-041c-488e-a961-6c37f530e1b9', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Cloning 12bc0a58-041c-488e-a961-6c37f530e1b9 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 45, 41, 667822)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.coordination [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 45, 41, 681790)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] create snapshot v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_12bc0a58-041c-488e-a961-6c37f530e1b9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] create volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 from snapshot v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:45:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:42 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'is_clone': True, 'full_name': 'Pool-0/v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'name': 'v_12bc0a58-041c-488e-a961-6c37f530e1b9'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] get volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434552', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '109323', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17055314365581700747', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'acc3c34717461e98', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331856896', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79462', 'name': 'v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Marking volume 12bc0a58-041c-488e-a961-6c37f530e1b9 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Creating volume glance metadata for volume 12bc0a58-041c-488e-a961-6c37f530e1b9 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2249a5a8-cb12-4dc2-af16-8cc6c7ad9a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12bc0a58-041c-488e-a961-6c37f530e1b9', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b2eab2-b236-4881-947a-27fa5917b6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:45:43 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Volume volume-12bc0a58-041c-488e-a961-6c37f530e1b9 (12bc0a58-041c-488e-a961-6c37f530e1b9): created successfully Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b2eab2-b236-4881-947a-27fa5917b6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:45:43 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (007c7136-65ca-4229-a89d-d6c23f625612) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:45:43 user cinder-volume[84560]: INFO cinder.volume.manager [None req-f04dc164-cf68-4572-8f97-745b705dde16 tempest-TestVolumeBootPattern-260409128 None] Created volume successfully. Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] create export for volume: 12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] ensure volume 12bc0a58-041c-488e-a961-6c37f530e1b9 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] check if targe iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] create target and attach volume 12bc0a58-041c-488e-a961-6c37f530e1b9 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] create target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] atach volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 to target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:45:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6163633363333437', 'lun': 0, 'mode': 'wt', 'name': 'v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'prod_id': 'Storage', 'scsi_id': 'acc3c34717461e98'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] add credentails to target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'name': 'SjFWIcAx'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] initialize_connection for 12bc0a58-041c-488e-a961-6c37f530e1b9 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:45:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SjFWIcAx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '48e5b1e8-d24c-4155-a0f1-0f5c4e5fce57'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:45:49 user cinder-volume[84560]: INFO cinder.volume.manager [req-9cedfa8d-d534-433e-8468-56bee4ebaafe req-e7922fef-40d9-4f7e-af26-81266b971781 tempest-TestVolumeBootPattern-260409128 None] attachment_update completed successfully. Apr 14 00:45:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=22,cinder:SELECT=51,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:45:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:UPDATE=19,cinder:INSERT=16,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:46:15 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:46:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:46:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:46:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:46:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:46:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:46:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321698816', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:46:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:46:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:46:35 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:46:55 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321678336', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:47:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:47:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] create snapshot fecef658-19bb-4067-83f9-27e3c2e3f0d7 for volume 12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:47:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] cloning v_12bc0a58-041c-488e-a961-6c37f530e1b9 to s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:47:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] create snapshot s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:47:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_fecef658-19bb-4067-83f9-27e3c2e3f0d7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] create volume s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 from snapshot s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:47:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:36 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_12bc0a58-041c-488e-a961-6c37f530e1b9@s_fecef658-19bb-4067-83f9-27e3c2e3f0d7', 'is_clone': True, 'full_name': 'Pool-0/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7', 'name': 's_fecef658-19bb-4067-83f9-27e3c2e3f0d7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:37 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] volume s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:47:37 user cinder-volume[84560]: INFO cinder.volume.manager [req-bb3f7998-efea-47c2-aba2-cec3353a7e5e req-76cc6afe-9802-4869-941a-79d4cf8b3bd0 tempest-TestVolumeBootPattern-260409128 None] Create snapshot completed successfully Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (a7eef78f-6ecd-4822-9aad-3a2e39ac31f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7d5ad0-4647-4d19-ba14-b5fa44dac76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d7d5ad0-4647-4d19-ba14-b5fa44dac76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:47:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85461f29-04e3-4204-8171-9893ac35c973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fecef658-19bb-4067-83f9-27e3c2e3f0d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:47:40Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0e2f7d-7f25-455f-b54a-fdc2962eaa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b0e2f7d-7f25-455f-b54a-fdc2962eaa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf88a6eb-7f66-4928-aba7-a07ba2378515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf88a6eb-7f66-4928-aba7-a07ba2378515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85461f29-04e3-4204-8171-9893ac35c973', 'volume_name': 'volume-85461f29-04e3-4204-8171-9893ac35c973', 'volume_size': 1, 'snapshot_id': 'fecef658-19bb-4067-83f9-27e3c2e3f0d7'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab9336d-f4c5-4564-8ba4-2a84fe61c1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ab9336d-f4c5-4564-8ba4-2a84fe61c1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b4b070-ab4e-40be-8e3f-33f582a47cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:47:39 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Volume 85461f29-04e3-4204-8171-9893ac35c973: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85461f29-04e3-4204-8171-9893ac35c973', 'volume_size': 1, 'snapshot_id': 'fecef658-19bb-4067-83f9-27e3c2e3f0d7'} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] create volume 85461f29-04e3-4204-8171-9893ac35c973 from snapshot fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] cloning s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 to v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] create snapshot v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:39 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_85461f29-04e3-4204-8171-9893ac35c973'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] create volume v_85461f29-04e3-4204-8171-9893ac35c973 from snapshot v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:47:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:40 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7@v_85461f29-04e3-4204-8171-9893ac35c973', 'is_clone': True, 'full_name': 'Pool-0/v_85461f29-04e3-4204-8171-9893ac35c973', 'name': 'v_85461f29-04e3-4204-8171-9893ac35c973'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] get volume v_85461f29-04e3-4204-8171-9893ac35c973 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7@v_85461f29-04e3-4204-8171-9893ac35c973', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_85461f29-04e3-4204-8171-9893ac35c973', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434670', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '109361', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8448383332247627549', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '683f0b7503027a5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321633280', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80576', 'name': 'v_85461f29-04e3-4204-8171-9893ac35c973', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Marking volume 85461f29-04e3-4204-8171-9893ac35c973 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Copying metadata from snapshot fecef658-19bb-4067-83f9-27e3c2e3f0d7 to 85461f29-04e3-4204-8171-9893ac35c973. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86b4b070-ab4e-40be-8e3f-33f582a47cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85461f29-04e3-4204-8171-9893ac35c973', 'volume_size': 1, 'snapshot_id': 'fecef658-19bb-4067-83f9-27e3c2e3f0d7'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e74b98-a944-4570-a033-651ca51cf045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:47:41 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Volume volume-85461f29-04e3-4204-8171-9893ac35c973 (85461f29-04e3-4204-8171-9893ac35c973): created successfully Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e74b98-a944-4570-a033-651ca51cf045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:47:41 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (a7eef78f-6ecd-4822-9aad-3a2e39ac31f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:47:41 user cinder-volume[84560]: INFO cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-163ef0c0-3139-4c9e-94cd-c16e59d774b6 tempest-TestVolumeBootPattern-260409128 None] Created volume successfully. Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] create export for volume: 85461f29-04e3-4204-8171-9893ac35c973. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] ensure volume 85461f29-04e3-4204-8171-9893ac35c973 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] check if targe iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] create target and attach volume 85461f29-04e3-4204-8171-9893ac35c973 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] create target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] atach volume v_85461f29-04e3-4204-8171-9893ac35c973 to target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:47:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3638336630623735', 'lun': 0, 'mode': 'wt', 'name': 'v_85461f29-04e3-4204-8171-9893ac35c973', 'prod_id': 'Storage', 'scsi_id': '683f0b7503027a5d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] add credentails to target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'name': 'DQOlTxXw'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=6,cinder:INSERT=13,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] initialize_connection for 85461f29-04e3-4204-8171-9893ac35c973 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:47:49 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DQOlTxXw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '405a207a-3f6f-466b-bb56-510496666cd4'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:47:49 user cinder-volume[84560]: INFO cinder.volume.manager [req-a1b98ec6-ab28-4aad-94d4-a081e4dc61b6 req-2094feb2-3758-4ca1-9b81-3523d363ed61 tempest-TestVolumeBootPattern-260409128 None] attachment_update completed successfully. Apr 14 00:48:05 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=36,cinder:INSERT=11,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:48:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:48:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:48:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:48:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:48:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:48:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:48:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321309696', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:48:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:48:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:48:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:48:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:48:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:49:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:49:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:49:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321301504', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:49:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:49:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] terminate connection for 85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:49:31 user cinder-volume[84560]: INFO cinder.volume.manager [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Terminate volume connection completed successfully. Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Deleting attachment 405a207a-3f6f-466b-bb56-510496666cd4. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 85461f29-04e3-4204-8171-9893ac35c973. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:47:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85461f29-04e3-4204-8171-9893ac35c973,launched_at=2023-04-14T00:47:42Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP DQOlTxXw t6i3qjGFvkhpAO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:47:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=fecef658-19bb-4067-83f9-27e3c2e3f0d7,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:47:50Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] detach volume v_85461f29-04e3-4204-8171-9893ac35c973 from target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-42b2d073-8cd5-458a-9a5e-9e6d075f6145 tempest-TestVolumeBootPattern-260409128 None] target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.coordination [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-85461f29-04e3-4204-8171-9893ac35c973-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:49:31 user cinder-volume[84560]: DEBUG cinder.coordination [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-85461f29-04e3-4204-8171-9893ac35c973-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 85461f29-04e3-4204-8171-9893ac35c973. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:47:40Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=85461f29-04e3-4204-8171-9893ac35c973,launched_at=2023-04-14T00:47:42Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP DQOlTxXw t6i3qjGFvkhpAO',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:47:40Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=fecef658-19bb-4067-83f9-27e3c2e3f0d7,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:49:32Z,updated_at=2023-04-14T00:49:32Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] detach volume v_85461f29-04e3-4204-8171-9893ac35c973 from target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973/luns/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 because of JDSS resource v_85461f29-04e3-4204-8171-9893ac35c973 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 because of JDSS resource iqn.2010-10.org.openstack:85461f29-04e3-4204-8171-9893ac35c973 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] deleating volume v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] get volume v_85461f29-04e3-4204-8171-9893ac35c973 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7@v_85461f29-04e3-4204-8171-9893ac35c973', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_85461f29-04e3-4204-8171-9893ac35c973', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434670', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26124288', 'sharesmb': None, 'createtxg': '109361', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '8448383332247627549', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '282624', 'logicalused': '1228800', 'compressratio': '5.26', 'rootcontext': 'none', 'default_scsi_id': '683f0b7503027a5d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321301504', 'san:volume_id': '683f0b7503027a5dc450427d9be39fc0eec46ab6', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '282624', 'objsetid': '80576', 'name': 'v_85461f29-04e3-4204-8171-9893ac35c973', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '282624', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] delete snapshot v_85461f29-04e3-4204-8171-9893ac35c973 of volume s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:32 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots/v_85461f29-04e3-4204-8171-9893ac35c973 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] snapshot v_85461f29-04e3-4204-8171-9893ac35c973 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.quota [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Created reservations ['2c723b94-6e97-408b-a69d-54ea0a7a800c', 'd67cc680-6176-4bb6-a77a-4759df0be898', 'a902a8f5-24b7-46cb-8204-c9c68f521a19', 'f81faf27-5a41-4071-a016-9e8ca9f4f32d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:49:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:49:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321633280', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:49:35 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:49:35 user cinder-volume[84560]: DEBUG cinder.manager [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:49:35 user cinder-volume[84560]: INFO cinder.volume.manager [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Deleted volume successfully. Apr 14 00:49:35 user cinder-volume[84560]: DEBUG cinder.coordination [req-d39e8b1d-59e7-4393-a738-2147ecb02c3d req-7f133be4-56ee-4f4c-9f54-3a493d93d6e2 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-85461f29-04e3-4204-8171-9893ac35c973-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:49:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=21,cinder:UPDATE=12,cinder:INSERT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=19,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-fecef658-19bb-4067-83f9-27e3c2e3f0d7-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:50:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-fecef658-19bb-4067-83f9-27e3c2e3f0d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:50:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] deleating snapshot s_fecef658-19bb-4067-83f9-27e3c2e3f0d7. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:50:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:50:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] get volume s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_12bc0a58-041c-488e-a961-6c37f530e1b9@s_fecef658-19bb-4067-83f9-27e3c2e3f0d7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434666', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '109355', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9786887366960439219', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'a1eae50616390f93', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321645568', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '80558', 'name': 's_fecef658-19bb-4067-83f9-27e3c2e3f0d7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] delete snapshot s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 of volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots/s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] snapshot s_fecef658-19bb-4067-83f9-27e3c2e3f0d7 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.quota [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Created reservations ['9f38e06e-a1a7-44b5-9321-fb4e11753b1b', '50da6c13-cb28-4f7e-9670-b832548e07c5', '3b5bb826-30ea-4d7c-8ed9-fb4c52552679', '52f368b2-5f40-4a8d-835d-31ad93db4e80'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:50:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Delete snapshot completed successfully. Apr 14 00:50:21 user cinder-volume[84560]: DEBUG cinder.coordination [None req-7e23d7a5-3172-4e5b-a528-d63e1869ee59 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-fecef658-19bb-4067-83f9-27e3c2e3f0d7-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:50:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321690624', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:50:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] terminate connection for 12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:50:23 user cinder-volume[84560]: INFO cinder.volume.manager [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Terminate volume connection completed successfully. Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Deleting attachment 48e5b1e8-d24c-4155-a0f1-0f5c4e5fce57. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-210590047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=12bc0a58-041c-488e-a961-6c37f530e1b9,launched_at=2023-04-14T00:45:43Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP SjFWIcAx 9scaArxMFjXRE4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:45:41Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:45:50Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] detach volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 from target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-53f669e2-e98a-47db-82b4-57e141bb9847 tempest-TestVolumeBootPattern-260409128 None] target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.coordination [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-12bc0a58-041c-488e-a961-6c37f530e1b9-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.coordination [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-12bc0a58-041c-488e-a961-6c37f530e1b9-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:45:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-210590047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=12bc0a58-041c-488e-a961-6c37f530e1b9,launched_at=2023-04-14T00:45:43Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP SjFWIcAx 9scaArxMFjXRE4',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:45:41Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:50:24Z,updated_at=2023-04-14T00:50:24Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] detach volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 from target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9/luns/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 because of JDSS resource v_12bc0a58-041c-488e-a961-6c37f530e1b9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 because of JDSS resource iqn.2010-10.org.openstack:12bc0a58-041c-488e-a961-6c37f530e1b9 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] deleating volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] get volume v_12bc0a58-041c-488e-a961-6c37f530e1b9 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434552', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26107904', 'sharesmb': None, 'createtxg': '109323', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '17055314365581700747', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10129408', 'logicalused': '25899008', 'compressratio': '2.57', 'rootcontext': 'none', 'default_scsi_id': 'acc3c34717461e98', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321678336', 'san:volume_id': 'acc3c34717461e989a78ad7aed5e645659112b5d', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10129408', 'objsetid': '79462', 'name': 'v_12bc0a58-041c-488e-a961-6c37f530e1b9', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10129408', 'logicalreferenced': '43593728', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] delete snapshot v_12bc0a58-041c-488e-a961-6c37f530e1b9 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_12bc0a58-041c-488e-a961-6c37f530e1b9 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] snapshot v_12bc0a58-041c-488e-a961-6c37f530e1b9 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.quota [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Created reservations ['d3fed469-026d-451b-99ba-e97cc48c3ef0', '03756338-0feb-4793-ae9c-bc3622de910c', '9bd34728-48e6-46de-8a1c-b70dfe455936', '6c61062b-3bcb-432e-bb2c-63780398285d'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:50:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:50:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331881472', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:50:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:50:27 user cinder-volume[84560]: DEBUG cinder.manager [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:50:27 user cinder-volume[84560]: INFO cinder.volume.manager [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Deleted volume successfully. Apr 14 00:50:27 user cinder-volume[84560]: DEBUG cinder.coordination [req-b5f274e2-c7b1-4e85-97c8-4da8a0c6513a req-393f972b-7cd0-47ca-8cbd-c35839dfe355 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-12bc0a58-041c-488e-a961-6c37f530e1b9-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:50:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=31,cinder:INSERT=3,cinder:UPDATE=17 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:50:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=13,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (244e1288-8a55-479f-b63c-12fbe7c83760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210fe467-5d4e-46b4-b3f6-0fb19f72dd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (210fe467-5d4e-46b4-b3f6-0fb19f72dd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-620970081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8a7edaa8-f67a-4251-8117-62a322c53de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:51:15Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20387f11-d597-44cb-8e2e-365bb54262ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20387f11-d597-44cb-8e2e-365bb54262ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61c80ba-e94b-42ed-a54b-7c2a84b69fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61c80ba-e94b-42ed-a54b-7c2a84b69fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a7edaa8-f67a-4251-8117-62a322c53de7', 'volume_name': 'volume-8a7edaa8-f67a-4251-8117-62a322c53de7', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339a53fa-83e7-4c14-be07-172f3bee382e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339a53fa-83e7-4c14-be07-172f3bee382e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1c5e69-c283-4b9a-a14f-71fcb1f019c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:51:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Volume 8a7edaa8-f67a-4251-8117-62a322c53de7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a7edaa8-f67a-4251-8117-62a322c53de7', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Cloning 8a7edaa8-f67a-4251-8117-62a322c53de7 from image 6db62068-7278-4cd8-b41f-d0140d89e199 at location (None, None). {{(pid=84560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1071}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" by "_prepare_image_cache_entry" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 51, 14, 895913)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Found cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:886}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-6db62068-7278-4cd8-b41f-d0140d89e199" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Attempting to retrieve cache entry for image = 6db62068-7278-4cd8-b41f-d0140d89e199 on host user@joviandss-2#joviandss-2. {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:827}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Found image-volume cache entry: {'id': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'volume_id': '27b4700f-a1b7-4450-8b39-5270a460f507', 'host': 'user@joviandss-2#joviandss-2', 'size': 1, 'image_updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6), 'last_used': datetime.datetime(2023, 4, 14, 0, 51, 14, 911544)}. {{(pid=84560) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.image.cache [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Image-volume cache entry image_update_at = 2023-04-14 00:01:06+00:00, requested image updated_at = 2023-04-14 00:01:06+00:00. {{(pid=84560) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Creating from source image-volume 27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:841}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] cloned volume 27b4700f-a1b7-4450-8b39-5270a460f507 to 8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:521}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] cloning v_27b4700f-a1b7-4450-8b39-5270a460f507 to v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] create snapshot v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_8a7edaa8-f67a-4251-8117-62a322c53de7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] create volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 from snapshot v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:51:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'is_clone': True, 'full_name': 'Pool-0/v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'name': 'v_8a7edaa8-f67a-4251-8117-62a322c53de7'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] get volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434885', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '16285696', 'sharesmb': None, 'createtxg': '109427', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11165926004456403614', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '94024c7bcdf6175c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331869184', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.17', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '79606', 'name': 'v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '19042304', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Marking volume 8a7edaa8-f67a-4251-8117-62a322c53de7 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Copying metadata from image 6db62068-7278-4cd8-b41f-d0140d89e199 to 8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:452}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Creating volume glance metadata for volume 8a7edaa8-f67a-4251-8117-62a322c53de7 backed by image 6db62068-7278-4cd8-b41f-d0140d89e199 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_name': 'cirros-0.5.2-x86_64-disk', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 16300544}. {{(pid=84560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:683}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de1c5e69-c283-4b9a-a14f-71fcb1f019c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a7edaa8-f67a-4251-8117-62a322c53de7', 'volume_size': 1, 'image_id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'image_location': (None, None), 'image_meta': {'name': 'cirros-0.5.2-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 16300544, 'virtual_size': 117440512, 'status': 'active', 'checksum': 'b874c39491a2377b8490f5f1e89761a4', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ccfc655ef7b947398980b9772e4864df', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6b813aa46bb90b4da216a4d19376593fa3f4fc7e617f03a92b7fe11e9a3981cbe8f0959dbebe36225e5f53dc4492341a4863cac4ed1ee0909f3fc78ef9c3e869', 'id': '6db62068-7278-4cd8-b41f-d0140d89e199', 'created_at': datetime.datetime(2023, 4, 14, 0, 1, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2023, 4, 14, 0, 1, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6db62068-7278-4cd8-b41f-d0140d89e199/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.5.2-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78245873-dd00-4fc7-af6a-f0fba057e6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:51:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Volume volume-8a7edaa8-f67a-4251-8117-62a322c53de7 (8a7edaa8-f67a-4251-8117-62a322c53de7): created successfully Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78245873-dd00-4fc7-af6a-f0fba057e6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:51:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (244e1288-8a55-479f-b63c-12fbe7c83760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:51:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b7936dc5-26bb-4242-aa4e-b32fbde0d301 tempest-TestVolumeBootPattern-260409128 None] Created volume successfully. Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] create export for volume: 8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] ensure volume 8a7edaa8-f67a-4251-8117-62a322c53de7 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] check if targe iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] create target and attach volume 8a7edaa8-f67a-4251-8117-62a322c53de7 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] create target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:51:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:51:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:51:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331844608', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:51:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:51:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] atach volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 to target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:51:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3934303234633762', 'lun': 0, 'mode': 'wt', 'name': 'v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'prod_id': 'Storage', 'scsi_id': '94024c7bcdf6175c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] add credentails to target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'name': 'gvTuEZAX'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=26,cinder:UPDATE=5,cinder:INSERT=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=22,cinder:UPDATE=7,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] initialize_connection for 8a7edaa8-f67a-4251-8117-62a322c53de7 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:51:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '0541f1d7-d085-4748-b500-6118bac24162'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:51:26 user cinder-volume[84560]: INFO cinder.volume.manager [req-5014db0e-a074-4cdb-b074-6c376bdaa209 req-e8c69f84-bc22-4c9f-a1d5-9e56ad11fa97 tempest-TestVolumeBootPattern-260409128 None] attachment_update completed successfully. Apr 14 00:51:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:51:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=16,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:52:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:52:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:52:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:52:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:52:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321711104', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:52:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:52:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:52:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:52:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] terminate connection for 8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:53:14 user cinder-volume[84560]: INFO cinder.volume.manager [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Terminate volume connection completed successfully. Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Deleting attachment 0541f1d7-d085-4748-b500-6118bac24162. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-620970081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8a7edaa8-f67a-4251-8117-62a322c53de7,launched_at=2023-04-14T00:51:17Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP gvTuEZAX kST93IfoHVuGdp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:51:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:51:26Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] detach volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 from target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:53:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a51449de-0f52-45de-9b4f-402659e7a295 req-389706b7-a1f6-4c95-a976-a2f41ced1b5e tempest-TestVolumeBootPattern-260409128 None] target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:53:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:53:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:53:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:53:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:53:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:53:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321694720', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:53:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:53:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:53:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:53:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] create export for volume: 8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] ensure volume 8a7edaa8-f67a-4251-8117-62a322c53de7 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] check if targe iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] create target and attach volume 8a7edaa8-f67a-4251-8117-62a322c53de7 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] create target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:54:04 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:54:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:54:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] atach volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 to target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:54:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:54:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3934303234633762', 'lun': 0, 'mode': 'wt', 'name': 'v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'prod_id': 'Storage', 'scsi_id': '94024c7bcdf6175c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] add credentails to target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'name': 'gvTuEZAX'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] initialize_connection for 8a7edaa8-f67a-4251-8117-62a322c53de7 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:54:08 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gvTuEZAX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '77614d82-8bef-4d0b-8643-dbb9e44620e9'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:54:08 user cinder-volume[84560]: INFO cinder.volume.manager [req-2d61e0c5-afc0-4d3d-bd05-5d567b5afd91 req-b9450442-6c28-4c33-aab2-d66df16838ba tempest-TestVolumeBootPattern-260409128 None] attachment_update completed successfully. Apr 14 00:54:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:54:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:54:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:54:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:54:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:54:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321682432', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:54:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:54:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:54:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:54:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321657856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:55:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:55:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] create snapshot 4862a1d0-fe60-40e9-b455-a269ef95daaa for volume 8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 00:55:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] cloning v_8a7edaa8-f67a-4251-8117-62a322c53de7 to s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:55:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] create snapshot s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:55:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:55:56 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:55:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_4862a1d0-fe60-40e9-b455-a269ef95daaa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] create volume s_4862a1d0-fe60-40e9-b455-a269ef95daaa from snapshot s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8a7edaa8-f67a-4251-8117-62a322c53de7@s_4862a1d0-fe60-40e9-b455-a269ef95daaa', 'is_clone': True, 'full_name': 'Pool-0/s_4862a1d0-fe60-40e9-b455-a269ef95daaa', 'name': 's_4862a1d0-fe60-40e9-b455-a269ef95daaa'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:55:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:55:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:55:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] volume s_4862a1d0-fe60-40e9-b455-a269ef95daaa properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 00:55:58 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5b7de97d-2c34-4fcb-b7f2-3805e489902f tempest-TestVolumeBootPattern-260409128 None] Create snapshot completed successfully Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (44845c4b-5258-4a00-b434-c343a88261bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240e943d-dafb-432c-909e-2df9fca36079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240e943d-dafb-432c-909e-2df9fca36079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-2122284077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5f9b46b9-9e36-44ab-a556-a4e4360bc408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:55:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4862a1d0-fe60-40e9-b455-a269ef95daaa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T00:55:59Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3592aed-37cb-4f59-b2d4-fe7ca1988777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3592aed-37cb-4f59-b2d4-fe7ca1988777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d325fa3e-294e-4b3b-9f27-88a278fc0e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d325fa3e-294e-4b3b-9f27-88a278fc0e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'volume_name': 'volume-5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'volume_size': 1, 'snapshot_id': '4862a1d0-fe60-40e9-b455-a269ef95daaa'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6515330-1189-46a2-b31d-e6c0217b702a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6515330-1189-46a2-b31d-e6c0217b702a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c12b1c-d6fc-46c2-b641-4c4f1f52a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:55:59 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Volume 5f9b46b9-9e36-44ab-a556-a4e4360bc408: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'volume_size': 1, 'snapshot_id': '4862a1d0-fe60-40e9-b455-a269ef95daaa'} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] create volume 5f9b46b9-9e36-44ab-a556-a4e4360bc408 from snapshot 4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] cloning s_4862a1d0-fe60-40e9-b455-a269ef95daaa to v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] create snapshot v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:55:59 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_5f9b46b9-9e36-44ab-a556-a4e4360bc408'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] create volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 from snapshot v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_4862a1d0-fe60-40e9-b455-a269ef95daaa@v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'is_clone': True, 'full_name': 'Pool-0/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'name': 'v_5f9b46b9-9e36-44ab-a556-a4e4360bc408'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] get volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_4862a1d0-fe60-40e9-b455-a269ef95daaa@v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435169', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '109504', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2631083176130017754', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '6fab98a9a55af27f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321600512', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81285', 'name': 'v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.volume_utils [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Marking volume 5f9b46b9-9e36-44ab-a556-a4e4360bc408 as bootable. {{(pid=84560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1140}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Copying metadata from snapshot 4862a1d0-fe60-40e9-b455-a269ef95daaa to 5f9b46b9-9e36-44ab-a556-a4e4360bc408. {{(pid=84560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:431}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18c12b1c-d6fc-46c2-b641-4c4f1f52a040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'volume_size': 1, 'snapshot_id': '4862a1d0-fe60-40e9-b455-a269ef95daaa'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a8a192-379e-41af-b219-9e99752eb0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 00:56:00 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Volume volume-5f9b46b9-9e36-44ab-a556-a4e4360bc408 (5f9b46b9-9e36-44ab-a556-a4e4360bc408): created successfully Apr 14 00:56:00 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17a8a192-379e-41af-b219-9e99752eb0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 00:56:01 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Flow 'volume_create_manager' (44845c4b-5258-4a00-b434-c343a88261bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 00:56:01 user cinder-volume[84560]: INFO cinder.volume.manager [None req-98d5aa5d-800a-452c-af7b-e65182a6771f tempest-TestVolumeBootPattern-260409128 None] Created volume successfully. Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] create export for volume: 5f9b46b9-9e36-44ab-a556-a4e4360bc408. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] ensure volume 5f9b46b9-9e36-44ab-a556-a4e4360bc408 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] check if targe iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] create target and attach volume 5f9b46b9-9e36-44ab-a556-a4e4360bc408 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] create target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] atach volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 to target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 00:56:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:06 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3666616239386139', 'lun': 0, 'mode': 'wt', 'name': 'v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'prod_id': 'Storage', 'scsi_id': '6fab98a9a55af27f'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] add credentails to target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 201, 'error': None, 'data': {'name': 'QnZXrEdu'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] initialize_connection for 5f9b46b9-9e36-44ab-a556-a4e4360bc408 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 00:56:07 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnZXrEdu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'f83ae752-6ab4-459a-94d2-12016e33e413'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 00:56:07 user cinder-volume[84560]: INFO cinder.volume.manager [req-a0654322-1487-4019-bb81-13bff8e9efe5 req-43e6d9c0-0bda-4cd2-9622-2e365d7121fb tempest-TestVolumeBootPattern-260409128 None] attachment_update completed successfully. Apr 14 00:56:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=38,cinder:INSERT=12,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:56:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:56:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:56:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:56:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:56:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321469440', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:56:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:56:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:56:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=25,cinder:UPDATE=8,cinder:INSERT=12,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:56:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:57:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:57:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:57:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:57:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:57:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321154048', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:57:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:57:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:57:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] terminate connection for 5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:57:57 user cinder-volume[84560]: INFO cinder.volume.manager [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Terminate volume connection completed successfully. Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Deleting attachment f83ae752-6ab4-459a-94d2-12016e33e413. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 5f9b46b9-9e36-44ab-a556-a4e4360bc408. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-2122284077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5f9b46b9-9e36-44ab-a556-a4e4360bc408,launched_at=2023-04-14T00:56:01Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP QnZXrEdu eiljVQnFNc4U3P',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:55:59Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=4862a1d0-fe60-40e9-b455-a269ef95daaa,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:56:08Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] detach volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 from target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:57:57 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:57:58 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-f5a3bc02-8c78-4694-91ef-c7df6ec19d87 req-dde8fd4d-f265-469e-8212-1a827e3a3e00 tempest-TestVolumeBootPattern-260409128 None] target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:58:07 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:58:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:58:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:58:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321149952', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:58:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:58:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-5f9b46b9-9e36-44ab-a556-a4e4360bc408-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-5f9b46b9-9e36-44ab-a556-a4e4360bc408-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 5f9b46b9-9e36-44ab-a556-a4e4360bc408. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:55:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-2122284077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=5f9b46b9-9e36-44ab-a556-a4e4360bc408,launched_at=2023-04-14T00:56:01Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP QnZXrEdu eiljVQnFNc4U3P',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:55:59Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=4862a1d0-fe60-40e9-b455-a269ef95daaa,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:58:46Z,updated_at=2023-04-14T00:58:46Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] detach volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 from target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408/luns/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 because of JDSS resource v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 because of JDSS resource iqn.2010-10.org.openstack:5f9b46b9-9e36-44ab-a556-a4e4360bc408 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] deleating volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] get volume v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_4862a1d0-fe60-40e9-b455-a269ef95daaa@v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435169', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '109504', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '2631083176130017754', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '266240', 'logicalused': '1097728', 'compressratio': '5.05', 'rootcontext': 'none', 'default_scsi_id': '6fab98a9a55af27f', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321137664', 'san:volume_id': '6fab98a9a55af27f7a0a1031d6b2077f81bae333', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.68', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '266240', 'objsetid': '81285', 'name': 'v_5f9b46b9-9e36-44ab-a556-a4e4360bc408', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '266240', 'logicalreferenced': '43855872', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] delete snapshot v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 of volume s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots/v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] snapshot v_5f9b46b9-9e36-44ab-a556-a4e4360bc408 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.quota [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Created reservations ['4e576584-2134-47bb-adff-ff0b8bd703d5', '2db09268-5b1d-40c2-b64a-cf825105f255', '2745902b-97b0-4428-95ff-7728719e62be', '82d716c2-d0ad-43f0-a4d0-625ed6a0b0fa'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:48 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'available': '114321465344', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.manager [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:58:49 user cinder-volume[84560]: INFO cinder.volume.manager [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Deleted volume successfully. Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-3739da38-fbdf-4a9e-92f9-16e00523026b tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-5f9b46b9-9e36-44ab-a556-a4e4360bc408-delete_volume" released by "delete_volume" :: held 2.850s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-4862a1d0-fe60-40e9-b455-a269ef95daaa-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-4862a1d0-fe60-40e9-b455-a269ef95daaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] deleating snapshot s_4862a1d0-fe60-40e9-b455-a269ef95daaa. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:49 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] get volume s_4862a1d0-fe60-40e9-b455-a269ef95daaa info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_8a7edaa8-f67a-4251-8117-62a322c53de7@s_4862a1d0-fe60-40e9-b455-a269ef95daaa', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_4862a1d0-fe60-40e9-b455-a269ef95daaa', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435166', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '109498', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '10069757567093729011', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '17db70d686a9c23b', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321465344', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '81075', 'name': 's_4862a1d0-fe60-40e9-b455-a269ef95daaa', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] delete snapshot s_4862a1d0-fe60-40e9-b455-a269ef95daaa of volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots/s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:50 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots/s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots/s_4862a1d0-fe60-40e9-b455-a269ef95daaa {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:51 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] snapshot s_4862a1d0-fe60-40e9-b455-a269ef95daaa deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:58:51 user cinder-volume[84560]: DEBUG cinder.quota [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Created reservations ['058cfe8d-7bbb-424c-8ed3-c85014e1cbe3', '6a4abbea-9f83-4a49-9900-50a786ad44c0', '9fd1b4bf-9e3b-4b01-8eb6-1a438d7323c6', '1cf8c909-bac9-4750-94bf-9145bf175f21'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:58:51 user cinder-volume[84560]: INFO cinder.volume.manager [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Delete snapshot completed successfully. Apr 14 00:58:51 user cinder-volume[84560]: DEBUG cinder.coordination [None req-6515b384-0454-4a64-b2f9-15cad611ea8b tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-4862a1d0-fe60-40e9-b455-a269ef95daaa-delete_snapshot" released by "delete_snapshot" :: held 2.080s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] terminate connection for 8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 00:58:54 user cinder-volume[84560]: INFO cinder.volume.manager [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Terminate volume connection completed successfully. Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Deleting attachment 77614d82-8bef-4d0b-8643-dbb9e44620e9. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-620970081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8a7edaa8-f67a-4251-8117-62a322c53de7,launched_at=2023-04-14T00:51:17Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP gvTuEZAX kST93IfoHVuGdp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:51:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='in-use',terminated_at=None,updated_at=2023-04-14T00:54:09Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] detach volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 from target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:58:54 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-524569e3-9c24-4e19-99f7-0be0a0339009 req-167d7a5d-1733-4507-8e7d-737017eb728a tempest-TestVolumeBootPattern-260409128 None] target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 00:59:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=18,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=34,cinder:UPDATE=11,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 00:59:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:59:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:59:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114321657856', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:59:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:59:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Acquiring lock "cinder-8a7edaa8-f67a-4251-8117-62a322c53de7-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.coordination [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-8a7edaa8-f67a-4251-8117-62a322c53de7-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] remove_export for volume: 8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T00:51:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-620970081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=8a7edaa8-f67a-4251-8117-62a322c53de7,launched_at=2023-04-14T00:51:17Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0934526a2dfa45f4bd5df4edee11d98a',provider_auth='CHAP gvTuEZAX kST93IfoHVuGdp',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T00:51:15Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T00:59:44Z,updated_at=2023-04-14T00:59:44Z,use_quota=True,user_id='cfb66031fcf84659a3b80cdb76ffddc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] detach volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 from target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7/luns/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 because of JDSS resource v_8a7edaa8-f67a-4251-8117-62a322c53de7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] delete target: iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] delete target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] failed to remove resource iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 because of JDSS resource iqn.2010-10.org.openstack:8a7edaa8-f67a-4251-8117-62a322c53de7 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] deleating volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] get snapshots for volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:43 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] get volume v_8a7edaa8-f67a-4251-8117-62a322c53de7 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_27b4700f-a1b7-4450-8b39-5270a460f507@v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681434885', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '26128384', 'sharesmb': None, 'createtxg': '109427', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '11165926004456403614', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '10149888', 'logicalused': '26030080', 'compressratio': '2.58', 'rootcontext': 'none', 'default_scsi_id': '94024c7bcdf6175c', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114321657856', 'san:volume_id': '94024c7bcdf6175c65b17359ca983573a612572c', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '1.67', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '10149888', 'objsetid': '79606', 'name': 'v_8a7edaa8-f67a-4251-8117-62a322c53de7', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '10149888', 'logicalreferenced': '43724800', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] delete snapshot v_8a7edaa8-f67a-4251-8117-62a322c53de7 of volume v_27b4700f-a1b7-4450-8b39-5270a460f507 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:44 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_27b4700f-a1b7-4450-8b39-5270a460f507/snapshots/v_8a7edaa8-f67a-4251-8117-62a322c53de7 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] snapshot v_8a7edaa8-f67a-4251-8117-62a322c53de7 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.quota [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Created reservations ['d1ea6972-2535-49b8-b0e8-069d2f396abd', 'e3a45be8-bf0a-4293-81f1-cae0a9579a59', '5cfdf66e-1678-4012-863b-dc932a83634c', '985a9345-8f03-4872-bab7-510bce0d13bf'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 00:59:45 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 00:59:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331881472', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 00:59:46 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 00:59:46 user cinder-volume[84560]: DEBUG cinder.manager [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 00:59:46 user cinder-volume[84560]: INFO cinder.volume.manager [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Deleted volume successfully. Apr 14 00:59:46 user cinder-volume[84560]: DEBUG cinder.coordination [None req-63b99961-1edf-44a0-921d-7ac5bb466da8 tempest-TestVolumeBootPattern-260409128 None] Lock "cinder-8a7edaa8-f67a-4251-8117-62a322c53de7-delete_volume" released by "delete_volume" :: held 2.741s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 00:59:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=16,cinder:UPDATE=13,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=19,cinder:INSERT=3,cinder:UPDATE=6 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:00:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:00:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:00:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:00:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:00:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331869184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:00:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:00:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:00:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:00:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:01:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:01:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:01:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:01:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:01:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:01:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331869184', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:01:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:01:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:01:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:01:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:01:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (e933139a-4443-48bc-820c-4a8187f80d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3465009-5c32-454a-bc58-a677d8f29188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3465009-5c32-454a-bc58-a677d8f29188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1775137443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=741de32b-bc3e-4427-a231-40e54c136117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:02:02Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53717cdf-971e-4c39-8d8f-51009f517822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53717cdf-971e-4c39-8d8f-51009f517822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352d0440-f75c-4770-aa6f-2e668df1e3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (352d0440-f75c-4770-aa6f-2e668df1e3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741de32b-bc3e-4427-a231-40e54c136117', 'volume_name': 'volume-741de32b-bc3e-4427-a231-40e54c136117', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b4e93-5e86-41b3-8b47-29d8f3b70429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4b4e93-5e86-41b3-8b47-29d8f3b70429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907d97a8-b3f3-43b3-88e6-ef568ec52aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:02:02 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Volume 741de32b-bc3e-4427-a231-40e54c136117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741de32b-bc3e-4427-a231-40e54c136117', 'volume_size': 1} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] creating volume v_741de32b-bc3e-4427-a231-40e54c136117. {{(pid=84560) create_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:145}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] create volume {'name': 'v_741de32b-bc3e-4427-a231-40e54c136117', 'size': '1073741824', 'sparse': True, 'blocksize': '128K'} {{(pid=84560) create_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:135}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:02 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:03 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'full_name': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117', 'is_clone': False, 'name': 'v_741de32b-bc3e-4427-a231-40e54c136117'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907d97a8-b3f3-43b3-88e6-ef568ec52aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741de32b-bc3e-4427-a231-40e54c136117', 'volume_size': 1}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:02:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c331cf-74f1-4f1c-b7e7-42fb482ff923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:02:03 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Volume volume-741de32b-bc3e-4427-a231-40e54c136117 (741de32b-bc3e-4427-a231-40e54c136117): created successfully Apr 14 01:02:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c331cf-74f1-4f1c-b7e7-42fb482ff923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:02:03 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (e933139a-4443-48bc-820c-4a8187f80d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:02:03 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b9c4a4cb-963b-4671-9a14-5f079d5cbb83 tempest-SnapshotDataIntegrityTests-212903653 None] Created volume successfully. Apr 14 01:02:07 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=11,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] create export for volume: 741de32b-bc3e-4427-a231-40e54c136117. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] ensure volume 741de32b-bc3e-4427-a231-40e54c136117 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] check if targe iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] create target and attach volume 741de32b-bc3e-4427-a231-40e54c136117 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] create target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:07 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] atach volume v_741de32b-bc3e-4427-a231-40e54c136117 to target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:02:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:09 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6634366636373863', 'lun': 0, 'mode': 'wt', 'name': 'v_741de32b-bc3e-4427-a231-40e54c136117', 'prod_id': 'Storage', 'scsi_id': 'f46f678ca7a0688d'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] add credentails to target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'name': 'VKcXGqJg'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] initialize_connection for 741de32b-bc3e-4427-a231-40e54c136117 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:02:11 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VKcXGqJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '77033de1-738c-4a64-a37c-260e0742a881'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:02:11 user cinder-volume[84560]: INFO cinder.volume.manager [req-de25f916-2b09-4e34-8f98-7f827e22d812 req-ef4fd9b3-3bf3-4658-957c-b6983b5a5d1f tempest-SnapshotDataIntegrityTests-212903653 None] attachment_update completed successfully. Apr 14 01:02:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot 68a6f259-8ee9-4a58-b814-7efb5b59a871 for volume 741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:02:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] cloning v_741de32b-bc3e-4427-a231-40e54c136117 to s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:02:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:02:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_68a6f259-8ee9-4a58-b814-7efb5b59a871'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] create volume s_68a6f259-8ee9-4a58-b814-7efb5b59a871 from snapshot s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:02:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117@s_68a6f259-8ee9-4a58-b814-7efb5b59a871', 'is_clone': True, 'full_name': 'Pool-0/s_68a6f259-8ee9-4a58-b814-7efb5b59a871', 'name': 's_68a6f259-8ee9-4a58-b814-7efb5b59a871'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] volume s_68a6f259-8ee9-4a58-b814-7efb5b59a871 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:02:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a9f186a4-9c95-43e2-996b-5da9d65a667e tempest-SnapshotDataIntegrityTests-212903653 None] Create snapshot completed successfully Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot 5bb2c476-25e2-4681-86da-8372c2a98c9b for volume 741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] cloning v_741de32b-bc3e-4427-a231-40e54c136117 to s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_5bb2c476-25e2-4681-86da-8372c2a98c9b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] create volume s_5bb2c476-25e2-4681-86da-8372c2a98c9b from snapshot s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:02:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117@s_5bb2c476-25e2-4681-86da-8372c2a98c9b', 'is_clone': True, 'full_name': 'Pool-0/s_5bb2c476-25e2-4681-86da-8372c2a98c9b', 'name': 's_5bb2c476-25e2-4681-86da-8372c2a98c9b'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] volume s_5bb2c476-25e2-4681-86da-8372c2a98c9b properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:02:18 user cinder-volume[84560]: INFO cinder.volume.manager [None req-8703ec51-eb58-4896-b35a-7386b615fcfc tempest-SnapshotDataIntegrityTests-212903653 None] Create snapshot completed successfully Apr 14 01:02:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot 12a43336-4d92-46c3-8f67-655ade039221 for volume 741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:625}} Apr 14 01:02:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] cloning v_741de32b-bc3e-4427-a231-40e54c136117 to s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:02:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:02:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'name': 's_12a43336-4d92-46c3-8f67-655ade039221'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] create volume s_12a43336-4d92-46c3-8f67-655ade039221 from snapshot s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:02:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117@s_12a43336-4d92-46c3-8f67-655ade039221', 'is_clone': True, 'full_name': 'Pool-0/s_12a43336-4d92-46c3-8f67-655ade039221', 'name': 's_12a43336-4d92-46c3-8f67-655ade039221'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/properties {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Sending PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': None} from PUT to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/properties {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] volume s_12a43336-4d92-46c3-8f67-655ade039221 properties updated {{(pid=84560) modify_property_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:301}} Apr 14 01:02:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-18ccf7c9-92e7-45cd-aba6-21c689fcadd5 tempest-SnapshotDataIntegrityTests-212903653 None] Create snapshot completed successfully Apr 14 01:02:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114330734592', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] terminate connection for 741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:02:22 user cinder-volume[84560]: INFO cinder.volume.manager [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Terminate volume connection completed successfully. Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Deleting attachment 77033de1-738c-4a64-a37c-260e0742a881. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: 741de32b-bc3e-4427-a231-40e54c136117. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1775137443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=741de32b-bc3e-4427-a231-40e54c136117,launched_at=2023-04-14T01:02:04Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP VKcXGqJg fljHa3tqIu5kzB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:02:02Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:02:22Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_741de32b-bc3e-4427-a231-40e54c136117 from target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:02:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:02:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:02:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-65b5c058-d4d2-41bc-8794-ae7f6aaf1aa4 req-3e584e02-f218-45b7-aa6a-b8be59f4b4bd tempest-SnapshotDataIntegrityTests-212903653 None] target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:02:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=37,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:02:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=8,cinder:SELECT=25,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (f375b8b2-6bd6-4c3c-8235-9cc5e679e617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5563192-ba86-4a7e-be42-39a1812b7cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5563192-ba86-4a7e-be42-39a1812b7cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-723883999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2c7f118b-fbc9-4f79-8d22-e15c5677aed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=68a6f259-8ee9-4a58-b814-7efb5b59a871,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:03:12Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc6f3b3-ea01-4e97-b44d-429457774d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abc6f3b3-ea01-4e97-b44d-429457774d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665c6b1d-0016-4640-979a-1a7347fd2d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (665c6b1d-0016-4640-979a-1a7347fd2d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'volume_name': 'volume-2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'volume_size': 1, 'snapshot_id': '68a6f259-8ee9-4a58-b814-7efb5b59a871'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bc2e9a-47c5-48f4-adf0-bcc178f79eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57bc2e9a-47c5-48f4-adf0-bcc178f79eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0483d702-1451-459f-b785-a5b282adbb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:03:12 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'volume_size': 1, 'snapshot_id': '68a6f259-8ee9-4a58-b814-7efb5b59a871'} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] create volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 from snapshot 68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] cloning s_68a6f259-8ee9-4a58-b814-7efb5b59a871 to v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:12 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] create volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 from snapshot v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:03:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:13 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_68a6f259-8ee9-4a58-b814-7efb5b59a871@v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'is_clone': True, 'full_name': 'Pool-0/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'name': 'v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_68a6f259-8ee9-4a58-b814-7efb5b59a871@v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435602', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '109644', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1597657655015061076', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '37cf44522f37758e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330734592', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80605', 'name': 'v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0483d702-1451-459f-b785-a5b282adbb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'volume_size': 1, 'snapshot_id': '68a6f259-8ee9-4a58-b814-7efb5b59a871'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff89fee6-b1c6-48e3-b6df-562259404d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:03:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Volume volume-2c7f118b-fbc9-4f79-8d22-e15c5677aed5 (2c7f118b-fbc9-4f79-8d22-e15c5677aed5): created successfully Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff89fee6-b1c6-48e3-b6df-562259404d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:03:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (f375b8b2-6bd6-4c3c-8235-9cc5e679e617) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:03:14 user cinder-volume[84560]: INFO cinder.volume.manager [None req-5ae7f0fe-bb7a-4c52-9083-1052f9534aa2 tempest-SnapshotDataIntegrityTests-212903653 None] Created volume successfully. Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] create export for volume: 2c7f118b-fbc9-4f79-8d22-e15c5677aed5. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] ensure volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] check if targe iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] create target and attach volume 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] create target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] atach volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 to target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:03:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3337636634343532', 'lun': 0, 'mode': 'wt', 'name': 'v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'prod_id': 'Storage', 'scsi_id': '37cf44522f37758e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] add credentails to target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'name': 'nejNuvOC'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=14,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] initialize_connection for 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:03:19 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nejNuvOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '24b4abc0-23cd-402e-b23e-75c37e028c6a'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:03:19 user cinder-volume[84560]: INFO cinder.volume.manager [req-a7fa3bf5-abfe-4453-9673-1a53d953673f req-7c5e511c-4a3f-49af-ae47-f525395aa1dd tempest-SnapshotDataIntegrityTests-212903653 None] attachment_update completed successfully. Apr 14 01:03:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114330710016', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:03:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] terminate connection for 2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:03:24 user cinder-volume[84560]: INFO cinder.volume.manager [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Terminate volume connection completed successfully. Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Deleting attachment 24b4abc0-23cd-402e-b23e-75c37e028c6a. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: 2c7f118b-fbc9-4f79-8d22-e15c5677aed5. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-723883999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2c7f118b-fbc9-4f79-8d22-e15c5677aed5,launched_at=2023-04-14T01:03:14Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP nejNuvOC JIgwaTvpilKnEc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:03:12Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=68a6f259-8ee9-4a58-b814-7efb5b59a871,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:03:23Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 from target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:03:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:03:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:03:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-2471f735-9a5d-4f5e-854f-890946816550 req-548ad9c1-129f-43a7-a2d0-1cfc78b10e7c tempest-SnapshotDataIntegrityTests-212903653 None] target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:03:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=11 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=25,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:03:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (3634c432-0853-4e94-9ec5-1bafb38b9675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb737142-fe30-4f15-b769-166e198820e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb737142-fe30-4f15-b769-166e198820e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1875259776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f94c5daf-01f1-4cd1-9137-28be67b2ef8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5bb2c476-25e2-4681-86da-8372c2a98c9b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:04:14Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f228287d-3941-473c-af92-c5881e57b072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f228287d-3941-473c-af92-c5881e57b072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38e1693-a760-445d-9365-3ff5f45ba1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d38e1693-a760-445d-9365-3ff5f45ba1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'volume_name': 'volume-f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'volume_size': 1, 'snapshot_id': '5bb2c476-25e2-4681-86da-8372c2a98c9b'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ec88e3-98c3-4c4b-97a5-b1c70562830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ec88e3-98c3-4c4b-97a5-b1c70562830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d021857e-ac20-4167-97e4-b843956a3791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:04:14 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'volume_size': 1, 'snapshot_id': '5bb2c476-25e2-4681-86da-8372c2a98c9b'} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] create volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e from snapshot 5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] cloning s_5bb2c476-25e2-4681-86da-8372c2a98c9b to v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:14 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] create volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e from snapshot v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5bb2c476-25e2-4681-86da-8372c2a98c9b@v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'is_clone': True, 'full_name': 'Pool-0/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'name': 'v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:15 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5bb2c476-25e2-4681-86da-8372c2a98c9b@v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435664', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '109668', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14702640912555073691', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3f793302ce1c2fd6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330566656', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '80225', 'name': 'v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d021857e-ac20-4167-97e4-b843956a3791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'volume_size': 1, 'snapshot_id': '5bb2c476-25e2-4681-86da-8372c2a98c9b'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:04:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9750a45-62b8-4148-8d9c-f61d501cb52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:04:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Volume volume-f94c5daf-01f1-4cd1-9137-28be67b2ef8e (f94c5daf-01f1-4cd1-9137-28be67b2ef8e): created successfully Apr 14 01:04:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9750a45-62b8-4148-8d9c-f61d501cb52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:04:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (3634c432-0853-4e94-9ec5-1bafb38b9675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:04:16 user cinder-volume[84560]: INFO cinder.volume.manager [None req-ca3b4c0d-bb67-4e17-aa38-2997dca9ad87 tempest-SnapshotDataIntegrityTests-212903653 None] Created volume successfully. Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] create export for volume: f94c5daf-01f1-4cd1-9137-28be67b2ef8e. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] ensure volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] check if targe iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] create target and attach volume f94c5daf-01f1-4cd1-9137-28be67b2ef8e to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] create target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] atach volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e to target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:04:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:20 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114330542080', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '3366373933333032', 'lun': 0, 'mode': 'wt', 'name': 'v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'prod_id': 'Storage', 'scsi_id': '3f793302ce1c2fd6'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] add credentails to target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'name': 'iHsWocdl'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] initialize_connection for f94c5daf-01f1-4cd1-9137-28be67b2ef8e 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:04:22 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iHsWocdl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': 'cda9b263-6fc2-4031-8f33-0008203e0b89'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:04:22 user cinder-volume[84560]: INFO cinder.volume.manager [req-17d1f4e5-29d1-493a-b562-66fa2c30853e req-9cf81680-f115-408d-8f77-02b7c3efdb4a tempest-SnapshotDataIntegrityTests-212903653 None] attachment_update completed successfully. Apr 14 01:04:26 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=29,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] terminate connection for f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:04:26 user cinder-volume[84560]: INFO cinder.volume.manager [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Terminate volume connection completed successfully. Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Deleting attachment cda9b263-6fc2-4031-8f33-0008203e0b89. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: f94c5daf-01f1-4cd1-9137-28be67b2ef8e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1875259776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f94c5daf-01f1-4cd1-9137-28be67b2ef8e,launched_at=2023-04-14T01:04:16Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP iHsWocdl zeqWo9RKuFamtk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:04:14Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=5bb2c476-25e2-4681-86da-8372c2a98c9b,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:04:26Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e from target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:04:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9cd53189-2454-41bd-91a2-5c4778b4aa8f req-174fb73d-09d1-411b-bf86-2450d5a10f68 tempest-SnapshotDataIntegrityTests-212903653 None] target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:04:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=8 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['user@joviandss-2#joviandss-2'], 'hosts': ['user@joviandss-2#joviandss-2']} {{(pid=84560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1368}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (f01b7970-35c5-4f97-9f7d-123540a8c22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb5d9b8-1568-4129-b766-6d53e689ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb5d9b8-1568-4129-b766-6d53e689ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-579185567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb5808d3-0dee-4531-988a-5d464f60c87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12a43336-4d92-46c3-8f67-655ade039221,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2023-04-14T01:05:17Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c)' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeedd03d-5695-4976-99c9-0288d9d7ae3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeedd03d-5695-4976-99c9-0288d9d7ae3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165f1daa-839b-4344-96a6-660ba548f6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165f1daa-839b-4344-96a6-660ba548f6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eb5808d3-0dee-4531-988a-5d464f60c87c', 'volume_name': 'volume-eb5808d3-0dee-4531-988a-5d464f60c87c', 'volume_size': 1, 'snapshot_id': '12a43336-4d92-46c3-8f67-655ade039221'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91394f-d727-4710-9070-111db9b97b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de91394f-d727-4710-9070-111db9b97b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e709488-9817-4328-80c7-8db75bfb5f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:05:16 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Volume eb5808d3-0dee-4531-988a-5d464f60c87c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eb5808d3-0dee-4531-988a-5d464f60c87c', 'volume_size': 1, 'snapshot_id': '12a43336-4d92-46c3-8f67-655ade039221'} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] create volume eb5808d3-0dee-4531-988a-5d464f60c87c from snapshot 12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:574}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] cloning s_12a43336-4d92-46c3-8f67-655ade039221 to v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) _clone_object /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:456}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] create snapshot v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) create_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:635}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'name': 'v_eb5808d3-0dee-4531-988a-5d464f60c87c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] create volume v_eb5808d3-0dee-4531-988a-5d464f60c87c from snapshot v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:674}} Apr 14 01:05:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/clone {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_12a43336-4d92-46c3-8f67-655ade039221@v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'is_clone': True, 'full_name': 'Pool-0/v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'name': 'v_eb5808d3-0dee-4531-988a-5d464f60c87c'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/clone {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_eb5808d3-0dee-4531-988a-5d464f60c87c info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_12a43336-4d92-46c3-8f67-655ade039221@v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435727', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '109693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9172953754317350120', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '0', 'logicalused': '0', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': 'b33cdf6c20f92e32', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330435584', 'used': '0', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '0', 'objsetid': '81417', 'name': 'v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e709488-9817-4328-80c7-8db75bfb5f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb5808d3-0dee-4531-988a-5d464f60c87c', 'volume_size': 1, 'snapshot_id': '12a43336-4d92-46c3-8f67-655ade039221'}' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1376ca-5dc0-43fa-a85c-4795461e41e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:190}} Apr 14 01:05:18 user cinder-volume[84560]: INFO cinder.volume.flows.manager.create_volume [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Volume volume-eb5808d3-0dee-4531-988a-5d464f60c87c (eb5808d3-0dee-4531-988a-5d464f60c87c): created successfully Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1376ca-5dc0-43fa-a85c-4795461e41e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84560) _task_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:178}} Apr 14 01:05:18 user cinder-volume[84560]: DEBUG cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Flow 'volume_create_manager' (f01b7970-35c5-4f97-9f7d-123540a8c22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84560) _flow_receiver /usr/local/lib/python3.10/dist-packages/taskflow/listeners/logging.py:141}} Apr 14 01:05:18 user cinder-volume[84560]: INFO cinder.volume.manager [None req-fa57dbd5-4d7d-43de-88b8-93c0502f0344 tempest-SnapshotDataIntegrityTests-212903653 None] Created volume successfully. Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] create export for volume: eb5808d3-0dee-4531-988a-5d464f60c87c. {{(pid=84560) create_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:699}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] ensure volume eb5808d3-0dee-4531-988a-5d464f60c87c assigned to a proper target {{(pid=84560) _ensure_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:866}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] check if targe iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c exists {{(pid=84560) is_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:376}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c'}, 'data': None} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] create target and attach volume eb5808d3-0dee-4531-988a-5d464f60c87c to it {{(pid=84560) _create_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:837}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] create target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) create_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:410}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114330423296', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'active': True, 'allow_ip': [], 'conflicted': False, 'deny_ip': [], 'incoming_users_active': True, 'name': 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c', 'outgoing_user': None}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] atach volume v_eb5808d3-0dee-4531-988a-5d464f60c87c to target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) attach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:576}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'block_size': 512, 'device_handler': 'vdisk_blockio', 'eui': '6233336364663663', 'lun': 0, 'mode': 'wt', 'name': 'v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'prod_id': 'Storage', 'scsi_id': 'b33cdf6c20f92e32'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] add credentails to target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) create_target_user /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:474}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/incoming-users {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Sending POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 201, 'error': None, 'data': {'name': 'etTzHxuQ'}} from POST to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/incoming-users {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] initialize_connection for eb5808d3-0dee-4531-988a-5d464f60c87c 10.0.0.210. {{(pid=84560) initialize_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1018}} Apr 14 01:05:23 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] Connection info returned from driver {'target_iqn': 'iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'etTzHxuQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'iscsi', 'attachment_id': '102b4b10-a988-494c-9043-70b61ff6d4eb'} {{(pid=84560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4875}} Apr 14 01:05:23 user cinder-volume[84560]: INFO cinder.volume.manager [req-9ab3eda7-7155-4e6b-995e-551d748d81f8 req-eb54f45f-a06b-4bfe-b596-6e33f8c0a0be tempest-SnapshotDataIntegrityTests-212903653 None] attachment_update completed successfully. Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] terminate connection for eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) terminate_connection /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:1032}} Apr 14 01:05:27 user cinder-volume[84560]: INFO cinder.volume.manager [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Terminate volume connection completed successfully. Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.manager [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Deleting attachment 102b4b10-a988-494c-9043-70b61ff6d4eb. {{(pid=84560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5006}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: eb5808d3-0dee-4531-988a-5d464f60c87c. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata=,attach_status='attached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-579185567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb5808d3-0dee-4531-988a-5d464f60c87c,launched_at=2023-04-14T01:05:19Z,metadata=,migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP etTzHxuQ JOvcX8iGFWzToC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:05:17Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=12a43336-4d92-46c3-8f67-655ade039221,snapshots=,source_volid=None,status='detaching',terminated_at=None,updated_at=2023-04-14T01:05:26Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=,volume_type=,volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_eb5808d3-0dee-4531-988a-5d464f60c87c from target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:05:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:05:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [req-db92366f-e8a6-41cf-a6c1-e7d940951a14 req-39e00f5f-ed6d-469d-8636-7a26c2468c4d tempest-SnapshotDataIntegrityTests-212903653 None] target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c deleted {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:447}} Apr 14 01:05:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=26,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:05:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=23,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-eb5808d3-0dee-4531-988a-5d464f60c87c-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-eb5808d3-0dee-4531-988a-5d464f60c87c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: eb5808d3-0dee-4531-988a-5d464f60c87c. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-579185567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=eb5808d3-0dee-4531-988a-5d464f60c87c,launched_at=2023-04-14T01:05:19Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP etTzHxuQ JOvcX8iGFWzToC',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:05:17Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=12a43336-4d92-46c3-8f67-655ade039221,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:06:17Z,updated_at=2023-04-14T01:06:17Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_eb5808d3-0dee-4531-988a-5d464f60c87c from target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c/luns/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c because of JDSS resource v_eb5808d3-0dee-4531-988a-5d464f60c87c DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c because of JDSS resource iqn.2010-10.org.openstack:eb5808d3-0dee-4531-988a-5d464f60c87c DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] deleating volume v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:16 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_eb5808d3-0dee-4531-988a-5d464f60c87c info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_12a43336-4d92-46c3-8f67-655ade039221@v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435727', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '109693', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '9172953754317350120', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': 'b33cdf6c20f92e32', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330279936', 'san:volume_id': 'b33cdf6c20f92e326a5ba5e2ae094be1f87e6e7b', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '81417', 'name': 'v_eb5808d3-0dee-4531-988a-5d464f60c87c', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] delete snapshot v_eb5808d3-0dee-4531-988a-5d464f60c87c of volume s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:17 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots/v_eb5808d3-0dee-4531-988a-5d464f60c87c {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] snapshot v_eb5808d3-0dee-4531-988a-5d464f60c87c deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.quota [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['8eb0010c-c33e-481c-9305-12b2d997c0c4', '5b91c598-04f1-4056-86e8-d96297ad5922', '015ca6ad-e427-4a45-98e6-95338c716ee4', '5ff11c9c-5a84-46dd-8471-e589d84679fe'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:18 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-f94c5daf-01f1-4cd1-9137-28be67b2ef8e-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-f94c5daf-01f1-4cd1-9137-28be67b2ef8e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: f94c5daf-01f1-4cd1-9137-28be67b2ef8e. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1875259776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=f94c5daf-01f1-4cd1-9137-28be67b2ef8e,launched_at=2023-04-14T01:04:16Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP iHsWocdl zeqWo9RKuFamtk',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:04:14Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=5bb2c476-25e2-4681-86da-8372c2a98c9b,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:06:19Z,updated_at=2023-04-14T01:06:19Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e from target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e/luns/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e because of JDSS resource v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e because of JDSS resource iqn.2010-10.org.openstack:f94c5daf-01f1-4cd1-9137-28be67b2ef8e DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] deleating volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'available': '114330447872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.manager [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:06:19 user cinder-volume[84560]: INFO cinder.volume.manager [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Deleted volume successfully. Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.coordination [None req-1ffeaeae-204a-4991-bd68-73a8f33d7457 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-eb5808d3-0dee-4531-988a-5d464f60c87c-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_5bb2c476-25e2-4681-86da-8372c2a98c9b@v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435664', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '109668', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '14702640912555073691', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '3f793302ce1c2fd6', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330447872', 'san:volume_id': '3f793302ce1c2fd66e52732d4a0d76cbe02741b5', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '80225', 'name': 'v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] delete snapshot v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e of volume s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:19 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots/v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] snapshot v_f94c5daf-01f1-4cd1-9137-28be67b2ef8e deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.quota [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['9f9f2879-ebca-42dd-8663-06df8dd40fb7', 'd0c6f455-5942-4131-8faa-cf9bf6cdf05c', '326121dd-caa7-48d5-8758-78b3bae6e3a8', 'a860674a-738e-40ea-8d4d-53f6883d5be2'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114330447872', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'available': '114330578944', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:06:21 user cinder-volume[84560]: DEBUG cinder.manager [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:06:21 user cinder-volume[84560]: INFO cinder.volume.manager [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Deleted volume successfully. Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-0e00b633-fd47-4df1-ac3e-c3c8a8bd87da tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-f94c5daf-01f1-4cd1-9137-28be67b2ef8e-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-2c7f118b-fbc9-4f79-8d22-e15c5677aed5-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-2c7f118b-fbc9-4f79-8d22-e15c5677aed5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: 2c7f118b-fbc9-4f79-8d22-e15c5677aed5. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-723883999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=2c7f118b-fbc9-4f79-8d22-e15c5677aed5,launched_at=2023-04-14T01:03:14Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP nejNuvOC JIgwaTvpilKnEc',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:03:12Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=68a6f259-8ee9-4a58-b814-7efb5b59a871,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:06:22Z,updated_at=2023-04-14T01:06:22Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 from target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5/luns/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 because of JDSS resource v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 because of JDSS resource iqn.2010-10.org.openstack:2c7f118b-fbc9-4f79-8d22-e15c5677aed5 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] deleating volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/s_68a6f259-8ee9-4a58-b814-7efb5b59a871@v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435602', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '109644', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '1597657655015061076', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '94208', 'logicalused': '434176', 'compressratio': '8.15', 'rootcontext': 'none', 'default_scsi_id': '37cf44522f37758e', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330578944', 'san:volume_id': '37cf44522f37758eb86047879d1398915ab59280', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '94208', 'objsetid': '80605', 'name': 'v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '94208', 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] delete snapshot v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 of volume s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:23 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots/v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] snapshot v_2c7f118b-fbc9-4f79-8d22-e15c5677aed5 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.quota [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['da0e7499-fac0-4e53-8a93-a9c92f0a30a9', 'a25a7dd6-4bc1-4340-b755-a09b40f4d1ee', 'ee6912b1-c970-476a-8192-430cb62db1b2', '2824745f-6de7-4587-920b-c79c7fb9167b'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-12a43336-4d92-46c3-8f67-655ade039221-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-12a43336-4d92-46c3-8f67-655ade039221-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] deleating snapshot s_12a43336-4d92-46c3-8f67-655ade039221. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:24 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] get volume s_12a43336-4d92-46c3-8f67-655ade039221 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'available': '114330722304', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.manager [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:06:25 user cinder-volume[84560]: INFO cinder.volume.manager [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Deleted volume successfully. Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.coordination [None req-a339c401-1792-451f-9108-ae5b05cb8fad tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-2c7f118b-fbc9-4f79-8d22-e15c5677aed5-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117@s_12a43336-4d92-46c3-8f67-655ade039221', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_12a43336-4d92-46c3-8f67-655ade039221', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435549', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '109625', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '800097502208468442', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3096eea2640245cb', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330722304', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '80499', 'name': 's_12a43336-4d92-46c3-8f67-655ade039221', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] delete snapshot s_12a43336-4d92-46c3-8f67-655ade039221 of volume v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:25 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_12a43336-4d92-46c3-8f67-655ade039221 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:26 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] snapshot s_12a43336-4d92-46c3-8f67-655ade039221 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:06:26 user cinder-volume[84560]: DEBUG cinder.quota [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['8cd7dc4a-a95f-45be-aaf8-02199ac54f91', '13657f6f-347b-4d38-bc69-ef6c0f57e5b5', '0f680fe9-10bb-473f-b387-f458a1c46cec', '436aba51-ce95-4ccc-a5e6-4ab8716da2de'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:26 user cinder-volume[84560]: INFO cinder.volume.manager [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Delete snapshot completed successfully. Apr 14 01:06:26 user cinder-volume[84560]: DEBUG cinder.coordination [None req-2ba91dfc-99e0-499d-b40b-3cdc56c364a8 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-12a43336-4d92-46c3-8f67-655ade039221-delete_snapshot" released by "delete_snapshot" :: held 2.169s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-5bb2c476-25e2-4681-86da-8372c2a98c9b-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:27 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-5bb2c476-25e2-4681-86da-8372c2a98c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] deleating snapshot s_5bb2c476-25e2-4681-86da-8372c2a98c9b. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:27 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] get volume s_5bb2c476-25e2-4681-86da-8372c2a98c9b info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117@s_5bb2c476-25e2-4681-86da-8372c2a98c9b', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_5bb2c476-25e2-4681-86da-8372c2a98c9b', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435547', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '372736', 'sharesmb': None, 'createtxg': '109619', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16499095013555040572', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '956d41be2b08cf90', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114330767360', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '5.58', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '80481', 'name': 's_5bb2c476-25e2-4681-86da-8372c2a98c9b', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1761280', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] delete snapshot s_5bb2c476-25e2-4681-86da-8372c2a98c9b of volume v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:28 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_5bb2c476-25e2-4681-86da-8372c2a98c9b {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:29 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] snapshot s_5bb2c476-25e2-4681-86da-8372c2a98c9b deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:06:29 user cinder-volume[84560]: DEBUG cinder.quota [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['347afaf1-5baa-4728-b98a-2718666b9fe9', '68525768-a4ec-4a70-8938-128a9fbca730', '9e392f8c-d37c-485a-8edc-333d74860c97', '087a6a92-6569-4899-9418-a65362291bfa'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:29 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=55,cinder:UPDATE=34,cinder:INSERT=9,cinder:DELETE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:29 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=56,cinder:UPDATE=32,cinder:INSERT=11,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:06:29 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Delete snapshot completed successfully. Apr 14 01:06:29 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b10886cd-57f4-40b5-993c-ea9171b2f1c3 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-5bb2c476-25e2-4681-86da-8372c2a98c9b-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-68a6f259-8ee9-4a58-b814-7efb5b59a871-delete_snapshot" by "delete_snapshot" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-68a6f259-8ee9-4a58-b814-7efb5b59a871-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] deleating snapshot s_68a6f259-8ee9-4a58-b814-7efb5b59a871. {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:649}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] get volume s_68a6f259-8ee9-4a58-b814-7efb5b59a871 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117@s_68a6f259-8ee9-4a58-b814-7efb5b59a871', 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/s_68a6f259-8ee9-4a58-b814-7efb5b59a871', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435545', 'sync': 'always', 'is_clone': True, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '266240', 'sharesmb': None, 'createtxg': '109613', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '16285732604334856795', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '8192', 'logicalused': '4096', 'compressratio': '1.00', 'rootcontext': 'none', 'default_scsi_id': '3b47c084a0bc62d9', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'on', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331013120', 'used': '8192', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '7.80', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '8192', 'objsetid': '80462', 'name': 's_68a6f259-8ee9-4a58-b814-7efb5b59a871', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'logicalreferenced': '1630208', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] delete snapshot s_68a6f259-8ee9-4a58-b814-7efb5b59a871 of volume v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:751}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:30 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots/s_68a6f259-8ee9-4a58-b814-7efb5b59a871 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:31 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] snapshot s_68a6f259-8ee9-4a58-b814-7efb5b59a871 deleted {{(pid=84560) delete_snapshot /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:772}} Apr 14 01:06:32 user cinder-volume[84560]: DEBUG cinder.quota [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['3a9d1c58-de55-4e53-a295-2b02601a5b48', 'e77bab20-9fc9-425b-8ac1-1f9ff54e2f5c', '5d64661d-031f-433a-942e-d436f1079e30', 'f7f8bfc1-86d8-4f8e-85c7-8fe1b259a550'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:32 user cinder-volume[84560]: INFO cinder.volume.manager [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Delete snapshot completed successfully. Apr 14 01:06:32 user cinder-volume[84560]: DEBUG cinder.coordination [None req-b07b01c2-7d9f-474d-a64a-a088fa6e228d tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-68a6f259-8ee9-4a58-b814-7efb5b59a871-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Acquiring lock "cinder-741de32b-bc3e-4427-a231-40e54c136117-delete_volume" by "delete_volume" {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:192}} Apr 14 01:06:33 user cinder-volume[84560]: DEBUG cinder.coordination [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-741de32b-bc3e-4427-a231-40e54c136117-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:196}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] remove_export for volume: 741de32b-bc3e-4427-a231-40e54c136117. {{(pid=84560) remove_export /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:718}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] remove export {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:912}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] detach volume:Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2023-04-14T01:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDataIntegrityTests-volume-1775137443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='user@joviandss-2#joviandss-2',id=741de32b-bc3e-4427-a231-40e54c136117,launched_at=2023-04-14T01:02:04Z,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed63b19014f048f5bf3f9938a151d30c',provider_auth='CHAP VKcXGqJg fljHa3tqIu5kzB',provider_geometry=None,provider_id=None,provider_location='172.16.0.220:3260,1 iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 0',replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2023-04-14T01:02:02Z,service_uuid='acd57883-590c-4574-95cc-3e61fe29180a',shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='deleting',terminated_at=2023-04-14T01:06:34Z,updated_at=2023-04-14T01:06:34Z,use_quota=True,user_id='1c8816bdfcab4ebca17b0c7ca90e5d39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4897ac4-9a58-4946-a239-ab48566b0a8c),volume_type_id=e4897ac4-9a58-4946-a239-ab48566b0a8c) from target:iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:913}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] detach volume v_741de32b-bc3e-4427-a231-40e54c136117 from target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) detach_target_vol /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:606}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117/luns/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 because of JDSS resource v_741de32b-bc3e-4427-a231-40e54c136117 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:920}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] delete target: iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:930}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] delete target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) delete_target /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:442}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 404, 'error': {'class': 'opene.exceptions.ItemNotFoundError', 'message': 'Target iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 not exists.', 'url': 'http://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117'}, 'data': None} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/san/iscsi/targets/iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] failed to remove resource iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 because of JDSS resource iqn.2010-10.org.openstack:741de32b-bc3e-4427-a231-40e54c136117 DNE. {{(pid=84560) _remove_target_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:935}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] deleating volume v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) delete_volume /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:266}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] get snapshots for volume v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) get_snapshots /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:816}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'results': 0, 'entries': []}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117/snapshots {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] get volume v_741de32b-bc3e-4427-a231-40e54c136117 info {{(pid=84560) get_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:239}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'origin': None, 'relatime': None, 'acltype': None, 'vscan': None, 'full_name': 'Pool-0/v_741de32b-bc3e-4427-a231-40e54c136117', 'userrefs': None, 'primarycache': 'all', 'logbias': 'latency', 'creation': '1681435532', 'sync': 'always', 'is_clone': False, 'dedup': 'off', 'sharenfs': None, 'receive_resume_token': None, 'volsize': '1073741824', 'referenced': '475136', 'sharesmb': None, 'createtxg': '109601', 'reservation': '0', 'scontext': None, 'mountpoint': None, 'casesensitivity': None, 'guid': '4414408719830769072', 'usedbyrefreservation': '0', 'dnodesize': None, 'written': '475136', 'logicalused': '1892352', 'compressratio': '4.52', 'rootcontext': 'none', 'default_scsi_id': 'f46f678ca7a0688d', 'type': 'volume', 'compression': 'lz4', 'snapdir': None, 'overlay': None, 'encryption': 'off', 'xattr': None, 'volmode': 'default', 'copies': '1', 'snapshot_limit': '18446744073709551615', 'aclinherit': None, 'defcontext': 'none', 'readonly': 'off', 'version': None, 'recordsize': None, 'filesystem_limit': None, 'mounted': None, 'mlslabel': 'none', 'secondarycache': 'all', 'refreservation': '0', 'available': '114331295744', 'san:volume_id': 'f46f678ca7a0688d819f9c22511cb3f23d2b548e', 'encryptionroot': None, 'exec': None, 'refquota': None, 'refcompressratio': '4.52', 'quota': None, 'utf8only': None, 'keylocation': 'none', 'snapdev': 'hidden', 'snapshot_count': '18446744073709551615', 'fscontext': 'none', 'clones': None, 'canmount': None, 'keystatus': None, 'atime': None, 'usedbysnapshots': '0', 'normalization': None, 'usedbychildren': '0', 'volblocksize': '131072', 'usedbydataset': '475136', 'objsetid': '81253', 'name': 'v_741de32b-bc3e-4427-a231-40e54c136117', 'defer_destroy': None, 'pbkdf2iters': '0', 'checksum': 'on', 'redundant_metadata': 'all', 'filesystem_count': None, 'devices': None, 'keyformat': 'none', 'setuid': None, 'used': '475136', 'logicalreferenced': '1892352', 'context': 'none', 'zoned': None, 'nbmand': None}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] delete volume:v_741de32b-bc3e-4427-a231-40e54c136117 recursively children:{'force_umount': True} {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:335}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:34 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 204} from DELETE to https://172.16.0.220:82/api/v3/pools/Pool-0/volumes/v_741de32b-bc3e-4427-a231-40e54c136117 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] volume v_741de32b-bc3e-4427-a231-40e54c136117 deleted {{(pid=84560) delete_lun /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:346}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.quota [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Created reservations ['f2b67fbf-3ff8-4039-b371-5ef970d4ad23', '511ab70e-4f5c-456b-ae90-04d785260870', '63317e53-1287-4356-9d06-fe1a6ba2907a', '215eccba-0af1-4e38-baa2-5eabf219b1fc'] {{(pid=84560) reserve /opt/stack/cinder/cinder/quota.py:755}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Geting {'code': 200, 'error': None, 'data': {'available': '114331820032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.manager [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:06:38 user cinder-volume[84560]: INFO cinder.volume.manager [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Deleted volume successfully. Apr 14 01:06:38 user cinder-volume[84560]: DEBUG cinder.coordination [None req-47e83f73-ff66-46ea-883f-be1d632b1da3 tempest-SnapshotDataIntegrityTests-212903653 None] Lock "cinder-741de32b-bc3e-4427-a231-40e54c136117-delete_volume" released by "delete_volume" :: held 4.907s {{(pid=84560) _synchronized /opt/stack/cinder/cinder/coordination.py:207}} Apr 14 01:06:56 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:06 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=26,cinder:INSERT=5,cinder:UPDATE=11 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:21 user cinder-volume[84560]: DEBUG oslo_service.periodic_task [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84560) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}} Apr 14 01:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Updating volume stats {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:724}} Apr 14 01:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Get pool Pool-0 fsprops {{(pid=84560) get_pool_stats /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest.py:894}} Apr 14 01:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending pool request GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) pool_request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:142}} Apr 14 01:07:21 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Sending GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:112}} Apr 14 01:07:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.jovian_common.rest_proxy [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Geting {'code': 200, 'error': None, 'data': {'available': '114331820032', 'status': 30, 'import_status': {'import_steps': {'san_setup': True, 'vip_setup': True, 'zfs_import': True, 'mount_system_volume': True, 'nas_setup': True}, 'import_successful': True}, 'scan': None, 'encryption': {'enabled': False}, 'deduplication_rate': '1.00', 'sysvol_upgrade': 'not_needed', 'vdevs': [{'name': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'disks': [{'origin': 'local', 'slot': '', 'led': 'off', 'name': 'sdn', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'alias': '', 'health': 'ONLINE', 'sn': '6000c296b793bf526a107a9d823e947a', 'trim_data': {'status': 'trim_unsupported', 'progress': None, 'trim_time': None}, 'path': 'pci-0000:03:00.0-scsi-0:0:14:0', 'model': 'Virtual disk', 'id': 'wwn-0x6000c296b793bf526a107a9d823e947a', 'size': 128849018880}], 'health': 'ONLINE', 'vdev_replacings': [], 'vdev_spares': [], 'type': ''}], 'id': '14181317334440137330', 'health': 'ONLINE', 'iostats': {'read': '0', 'write': '0', 'chksum': '0'}, 'operation': 'none', 'size': '127775277056', 'autotrim': False, 'name': 'Pool-0'}} from GET to https://172.16.0.220:82/api/v3/pools/Pool-0 {{(pid=84560) request /opt/stack/cinder/cinder/volume/drivers/open_e/jovian_common/rest_proxy.py:129}} Apr 14 01:07:22 user cinder-volume[84560]: DEBUG cinder.volume.drivers.open_e.iscsi [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Total capacity: 119, Free 106. {{(pid=84560) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/open_e/iscsi.py:757}} Apr 14 01:07:22 user cinder-volume[84560]: DEBUG cinder.manager [None req-b9571a81-7d3f-402b-95ea-9a9e7be5db96 None None] Notifying Schedulers of capabilities ... {{(pid=84560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 14 01:07:36 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 01:07:46 user cinder-volume[84560]: DEBUG dbcounter [-] [84560] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=84560) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}}